Sep 16 16:02:40 devstack cinder-volume[75235]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 16 16:02:40 devstack cinder-volume[75235]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 16:02:40 devstack cinder-volume[75235]: we strongly recommend against using it for new projects. Sep 16 16:02:40 devstack cinder-volume[75235]: If you are already using Eventlet, we recommend migrating to a different Sep 16 16:02:40 devstack cinder-volume[75235]: framework. For more detail see Sep 16 16:02:40 devstack cinder-volume[75235]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 16:02:40 devstack cinder-volume[75235]: import eventlet # noqa Sep 16 16:02:43 devstack cinder-volume[75235]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 16:02:43 devstack cinder-volume[75235]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 16:02:43 devstack cinder-volume[75235]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 16:02:44 devstack cinder-volume[75235]: INFO dbcounter [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Registered counter for database cinder Sep 16 16:02:44 devstack cinder-volume[75235]: DEBUG oslo_db.sqlalchemy.engines [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75235) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:02:44 devstack cinder-volume[75235]: DEBUG dbcounter [-] [75235] Writer thread running {{(pid=75235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 16:02:44 devstack cinder-volume[75235]: INFO cinder.rpc [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 16:02:44 devstack cinder-volume[75235]: INFO cinder.rpc [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 16:02:44 devstack cinder-volume[75235]: DEBUG oslo_db.sqlalchemy.engines [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75235) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:02:45 devstack cinder-volume[75235]: INFO cinder.volume.manager [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Determined volume DB was empty at startup. Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG cinder.volume.manager [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75235) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 16 16:02:45 devstack cinder-volume[75235]: INFO cinder.volume.manager [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 16:02:45 devstack cinder-volume[75235]: WARNING stevedore.named [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 16:02:45 devstack cinder-volume[75235]: WARNING castellan.key_manager [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 16:02:45 devstack cinder-volume[75235]: WARNING cinder.keymgr.conf_key_mgr [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG cinder.volume.drivers.lvm [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75235) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_concurrency.processutils [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_concurrency.processutils [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] CMD "cinder-rtstool verify" returned: 0 in 0.400s {{(pid=75235) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_db.sqlalchemy.engines [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75235) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:02:45 devstack cinder-volume[75235]: INFO cinder.rpc [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 16 16:02:45 devstack cinder-volume[75235]: INFO cinder.rpc [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 16 16:02:45 devstack cinder-volume[75235]: WARNING stevedore.named [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 16:02:45 devstack cinder-volume[75235]: WARNING castellan.key_manager [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 16:02:45 devstack cinder-volume[75235]: INFO cinder.volume.manager [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_db.sqlalchemy.engines [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75235) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:02:45 devstack cinder-volume[75235]: INFO oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Starting 1 workers Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Started child 75391 {{(pid=75235) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Full set of CONF: {{(pid=75235) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] ******************************************************************************** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Configuration options gathered from: {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 16 16:02:45 devstack cinder-volume[75391]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] ================================================================================ {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] allow_availability_zone_fallback = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] allow_compression_on_image_upload = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] allowed_direct_url_schemes = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] api_rate_limit = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] auth_strategy = keystone {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] az_cache_duration = 3600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_availability_zone = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_host = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_stats_polling_interval = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backup_api_class = cinder.backup.api.API {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backup_name_template = backup-%s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backup_use_same_host = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backup_use_temp_snapshot = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] chap_password = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] chap_username = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cinder_internal_tenant_project_id = c590631f10dc4f3c8688f85649a6fc27 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cinder_internal_tenant_user_id = a0594d4867714b1babbcffbc0563cbc1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cloned_volume_same_az = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cluster = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] compression_format = gzip {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] compute_api_class = cinder.compute.nova.API {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] config_dir = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] config_source = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] control_exchange = openstack {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] debug = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] default_availability_zone = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] default_group_type = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] default_volume_type = lvmdriver-1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] disk_geometry = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] driver_client_cert = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] driver_client_cert_key = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] driver_data_namespace = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] driver_ssl_cert_path = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] driver_ssl_cert_verify = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] driver_use_ssl = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] enable_force_upload = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] enable_new_services = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] enable_unsupported_driver = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] enabled_backends = ['lvmdriver-1'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] enforce_multipath_for_image_xfer = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] filter_function = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_api_insecure = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_api_ssl_compression = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_ca_certificates_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_catalog_info = image:glance:publicURL {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_keyfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_num_retries = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance_request_timeout = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] goodness_function = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] graceful_shutdown_timeout = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] group_api_class = cinder.group.api.API {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] host = devstack {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_compress_on_upload = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_conversion_address_space_limit = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_conversion_cpu_limit = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_conversion_disable = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_introspection_address_space_limit = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_introspection_cpu_limit = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_upload_use_cinder_backend = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_upload_use_internal_tenant = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_volume_cache_enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_volume_cache_max_count = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] image_volume_cache_max_size_gb = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] init_host_max_objects_retrieval = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] instance_format = [instance: %(uuid)s] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] iscsi_target_flags = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] iscsi_write_cache = on {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] iser_helper = tgtadm {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] iser_ip_address = 192.168.122.229 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] iser_port = 3260 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] log_color = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] log_config_append = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] log_dir = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] log_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] log_options = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] log_rotate_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] log_rotate_interval_type = days {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] log_rotation_type = none {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] max_age = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] max_logfile_count = 30 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] max_logfile_size_mb = 200 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] max_over_subscription_ratio = 20.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] message_reap_interval = 86400 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] message_ttl = 2592000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] migration_create_volume_timeout_secs = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75391]: INFO cinder.volume.manager [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] monkey_patch = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] monkey_patch_modules = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] my_ip = 192.168.122.229 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] no_snapshot_gb_quota = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] num_iser_scan_tries = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] num_shell_tries = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] num_volume_device_scan_tries = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] nvmeof_conn_info_version = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] nvmet_ns_id = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] nvmet_port_id = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] osapi_max_limit = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] osapi_volume_ext_list = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] osapi_volume_listen = 0.0.0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] osapi_volume_listen_port = 8776 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] osapi_volume_use_ssl = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] osapi_volume_workers = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] per_volume_size_limit = -1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] periodic_fuzzy_delay = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] periodic_interval = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] project_id_regex = [0-9a-f\-]+ {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] public_endpoint = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] publish_errors = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] quota_backup_gigabytes = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] quota_backups = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] quota_gigabytes = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] quota_groups = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] quota_snapshots = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] quota_volumes = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] rate_limit_burst = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] rate_limit_except_level = CRITICAL {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] rate_limit_interval = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] reinit_driver_count = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] replication_device = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] report_discard_supported = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] report_interval = 120 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] reservation_clean_interval = 86400 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] reservation_expire = 86400 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] reserved_image_namespaces = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] reserved_percentage = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] rpc_response_timeout = 120 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] run_external_periodic_tasks = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] scst_target_driver = iscsi {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] scst_target_iqn_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_down_time = 720 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] shell_completion = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] snapshot_name_template = snapshot-%s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] snapshot_same_host = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] split_loggers = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] state_path = /opt/stack/data/cinder {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] storage_availability_zone = nova {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] storage_protocol = iSCSI {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] syslog_log_facility = LOG_USER {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] target_helper = lioadm {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] target_ip_address = 192.168.122.229 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] target_port = 3260 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] target_protocol = iscsi {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] target_secondary_ip_addresses = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] trace_flags = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] transfer_api_class = cinder.transfer.api.API {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] transport_url = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] until_refresh = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] use_chap_auth = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] use_default_quota_class = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] use_journal = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] use_json = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] use_multipath_for_image_xfer = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] use_stderr = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] use_syslog = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] verify_glance_signatures = enabled {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_api_class = cinder.volume.api.API {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_backend_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_clear = zero {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_clear_ionice = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_clear_size = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_copy_bps_limit = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_dd_blocksize = 1M {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_name_template = volume-%s {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_service_inithost_offload = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volume_usage_audit_period = month {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] zoning_mode = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:02:45 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_concurrency.disable_process_locking = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.auth_section = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.auth_type = password {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.auth_version = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.cache = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.delay_auth_decision = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.http_connect_timeout = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.include_service_catalog = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.insecure = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.interface = public {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.keyfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_password = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcache_username = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.region_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.service_token_roles_required = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.service_type = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.token_cache_time = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.backend = dogpile.cache.null {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.backend_argument = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.backend_expiration_time = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.config_prefix = cache.oslo {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.debug_cache_backend = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.enable_retry_client = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.enable_socket_keepalive = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.expiration_time = 600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.hashclient_retry_attempts = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.memcache_dead_retry = 300 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.memcache_pool_maxsize = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.memcache_sasl_enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.password = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.proxies = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.redis_db = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.redis_sentinel_service_name = mymaster {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.redis_server = localhost:6379 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.retry_attempts = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.retry_delay = 0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.socket_keepalive_count = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.socket_keepalive_idle = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.socket_keepalive_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.socket_timeout = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.tls_allowed_ciphers = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.tls_cafile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.tls_certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.tls_enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.tls_keyfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cache.username = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] coordination.backend_url = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.asyncio_connection = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.asyncio_slave_connection = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.backend = sqlalchemy {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.connection = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.connection_debug = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.connection_parameters = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.connection_recycle_time = 3600 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.connection_trace = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.db_inc_retry_interval = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.db_max_retries = 20 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:45 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.db_max_retry_interval = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.db_retry_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.max_overflow = 50 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.max_pool_size = 5 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.max_retries = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.mysql_wsrep_sync_wait = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.pool_timeout = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.retry_interval = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.slave_connection = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.sqlite_synchronous = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.synchronous_reader = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] database.use_db_reconnect = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_tracing.insecure = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.connection_string = messaging:// {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.es_doc_type = notification {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.es_scroll_size = 10000 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.es_scroll_time = 2m {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.filter_error_trace = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.hmac_keys = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.sentinel_service_name = mymaster {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.socket_timeout = 0.1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.trace_requests = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler.trace_sqlalchemy = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler_jaeger.process_tags = {} {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler_jaeger.service_name_prefix = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack sudo[75395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 16 16:02:45 devstack sudo[75395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] profiler_otlp.service_name_prefix = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.enforce_new_defaults = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.policy_default_rule = default {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.policy_file = policy.yaml {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_policy.remote_timeout = 60.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] privsep_osbrick.group = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] privsep_osbrick.helper_command = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] privsep_osbrick.user = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cinder_sys_admin.group = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cinder_sys_admin.helper_command = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] cinder_sys_admin.user = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.auth_section = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.auth_type = password {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.cafile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.collect_timing = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.insecure = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.keyfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.send_service_user_token = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.split_loggers = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.timeout = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.tls_ciphers = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] service_user.tls_min_version = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.auth_section = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.auth_type = password {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.collect_timing = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.insecure = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.keyfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.region_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.split_loggers = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.timeout = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.tls_ciphers = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] glance.tls_min_version = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.backend_availability_zone = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.chap_password = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.chap_username = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.disk_geometry = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.driver_client_cert = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.driver_client_cert_key = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.driver_data_namespace = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.driver_use_ssl = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.enable_unsupported_driver = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.extra_capabilities = {} {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.filter_function = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.goodness_function = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.iscsi_target_flags = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.iscsi_write_cache = on {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.iser_helper = tgtadm {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.iser_port = 3260 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.lvm_mirrors = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.lvm_share_target = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.lvm_type = auto {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.num_shell_tries = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.nvmet_port_id = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.replication_device = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.report_discard_supported = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.reserved_percentage = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.scst_target_driver = iscsi {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.scst_target_iqn_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.storage_protocol = iSCSI {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.target_helper = tgtadm {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.target_port = 3260 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:45 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.target_protocol = iscsi {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.trace_flags = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.unique_fqdn_network = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.use_chap_auth = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volume_backend_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volume_clear = zero {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volume_clear_ionice = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volume_clear_size = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volume_group = cinder-volumes {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_reports.file_event_handler = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_reports.log_dir = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.backend_availability_zone = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.backend_host = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.chap_password = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.chap_username = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.chiscsi_conf = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.disk_geometry = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.driver_client_cert = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.driver_data_namespace = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.driver_use_ssl = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.extra_capabilities = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.filter_function = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.goodness_function = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.iser_helper = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.iser_ip_address = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.iser_port = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.iser_target_prefix = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.lvm_conf_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.lvm_mirrors = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.lvm_share_target = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.lvm_type = auto {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.num_shell_tries = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.nvmet_port_id = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.replication_device = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.report_discard_supported = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.reserved_percentage = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.scst_target_driver = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.storage_protocol = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.target_helper = lioadm {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.target_ip_address = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.target_port = 3260 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.target_protocol = iscsi {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.trace_flags = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.use_chap_auth = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volume_clear = zero {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volume_clear_size = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] lvmdriver-1.volumes_dir = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.ssl = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.ssl_version = {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_notifications.driver = [] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_notifications.retry = -1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] oslo_messaging_notifications.transport_url = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] key_manager.fixed_key = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.barbican_api_version = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.barbican_endpoint = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.barbican_endpoint_type = public {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.barbican_region_name = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.cafile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.collect_timing = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.insecure = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.keyfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.number_of_retries = 60 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.retry_delay = 1 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.send_service_user_token = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.split_loggers = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.timeout = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.tls_ciphers = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.tls_min_version = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.verify_ssl = True {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican.verify_ssl_path = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.auth_section = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.auth_type = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.cafile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.certfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.collect_timing = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.insecure = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.keyfile = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.split_loggers = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.timeout = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.tls_ciphers = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] barbican_service_user.tls_min_version = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.approle_role_id = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.approle_secret_id = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.auth_method = approle {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.auth_path = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.kv_mountpoint = secret {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.kv_path = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.kv_version = 2 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.namespace = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.root_token_id = **** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.ssl_ca_crt_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.timeout = 60.0 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.token_file = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.token_role = None {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.use_ssl = False {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:02:46 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] ******************************************************************************** {{(pid=75235) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 16 16:02:46 devstack sudo[75395]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:46 devstack sudo[75491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:02:46 devstack sudo[75491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:46 devstack sudo[75491]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.340s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:02:46 devstack cinder-volume[75391]: INFO cinder.brick.local_dev.lvm [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:46 devstack sudo[75596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:02:46 devstack sudo[75596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:46 devstack sudo[75596]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG cinder.brick.local_dev.lvm [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75391) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 16 16:02:46 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:46 devstack sudo[75699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:02:46 devstack sudo[75699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:47 devstack sudo[75699]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:47 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.515s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:47 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:47 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:47 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:47 devstack sudo[75888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:02:47 devstack sudo[75888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:47 devstack sudo[75888]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:47 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:47 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:47 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:47 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:47 devstack sudo[76005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 16 16:02:47 devstack sudo[76005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:48 devstack sudo[76005]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:48 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.279s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:48 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:48 devstack sudo[76008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:02:48 devstack sudo[76008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:48 devstack sudo[76008]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:48 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:48 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:48 devstack sudo[76091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:02:48 devstack sudo[76091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:48 devstack sudo[76091]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:48 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:48 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:48 devstack sudo[76094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:02:48 devstack sudo[76094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:48 devstack sudo[76094]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:48 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:48 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:48 devstack sudo[76111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:02:48 devstack sudo[76111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:49 devstack sudo[76111]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:49 devstack sudo[76187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:02:49 devstack sudo[76187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:49 devstack sudo[76187]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.320s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:49 devstack cinder-volume[75391]: INFO cinder.volume.drivers.lvm [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:49 devstack sudo[76191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:02:49 devstack sudo[76191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:49 devstack sudo[76191]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG cinder.volume.drivers.lvm [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Updating volume stats {{(pid=75391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 16:02:49 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:49 devstack sudo[76194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:02:49 devstack sudo[76194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:50 devstack sudo[76194]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:50 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:50 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:50 devstack sudo[76197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:02:50 devstack sudo[76197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:50 devstack sudo[76197]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:50 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:50 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:50 devstack sudo[76206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:02:50 devstack sudo[76206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:50 devstack sudo[76206]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:50 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:50 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:50 devstack sudo[76209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:02:50 devstack sudo[76209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:50 devstack sudo[76209]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:50 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:50 devstack cinder-volume[75391]: INFO cinder.volume.driver [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 16:02:50 devstack cinder-volume[75391]: DEBUG cinder.volume.driver [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75391) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG oslo_db.sqlalchemy.engines [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75391) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG dbcounter [-] [75391] Writer thread running {{(pid=75391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG cinder.db.api [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Building query based on filter {{(pid=75391) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG cinder.image.image_utils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75391) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 16 16:02:51 devstack cinder-volume[75391]: INFO cinder.keymgr.migration [None req-31257443-c1fe-42dd-8edd-670bce7b9a2d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG cinder.volume.drivers.lvm [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Updating volume stats {{(pid=75391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:51 devstack sudo[76213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:02:51 devstack sudo[76213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:51 devstack sudo[76213]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:51 devstack sudo[76217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:02:51 devstack sudo[76217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:51 devstack sudo[76217]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:51 devstack sudo[76221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:02:51 devstack sudo[76221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:51 devstack sudo[76221]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:51 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:52 devstack sudo[76224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:02:52 devstack sudo[76224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:52 devstack sudo[76224]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG cinder.manager [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Notifying Schedulers of capabilities ... {{(pid=75391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:02:52 devstack cinder-volume[75391]: INFO cinder.volume.manager [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Driver initialization completed successfully. Sep 16 16:02:52 devstack cinder-volume[75391]: INFO cinder.manager [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Initiating service 2 cleanup Sep 16 16:02:52 devstack cinder-volume[75391]: INFO cinder.manager [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Service 2 cleanup completed. Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG cinder.service [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Creating RPC server for service cinder-volume {{(pid=75391) start /opt/stack/cinder/cinder/service.py:231}} Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG cinder.service [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75391) start /opt/stack/cinder/cinder/service.py:237}} Sep 16 16:02:52 devstack cinder-volume[75391]: INFO cinder.volume.manager [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG cinder.volume.drivers.lvm [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Updating volume stats {{(pid=75391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:52 devstack sudo[76229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:02:52 devstack sudo[76229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:52 devstack sudo[76229]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:52 devstack sudo[76232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:02:52 devstack sudo[76232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:52 devstack sudo[76232]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:52 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:53 devstack sudo[76235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:02:53 devstack sudo[76235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:53 devstack sudo[76235]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:53 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:53 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:02:53 devstack sudo[76238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:02:53 devstack sudo[76238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:02:53 devstack sudo[76238]: pam_unix(sudo:session): session closed for user root Sep 16 16:02:53 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:02:53 devstack cinder-volume[75391]: INFO cinder.volume.manager [None req-27c94974-1e1e-4af8-bc99-fa042a0c9470 None None] Driver post RPC initialization completed successfully. Sep 16 16:02:55 devstack cinder-volume[75235]: DEBUG dbcounter [-] [75235] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75235) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:03:03 devstack cinder-volume[75391]: DEBUG dbcounter [-] [75391] Writing DB stats cinder:SELECT=3 {{(pid=75391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:03:03 devstack cinder-volume[75391]: DEBUG dbcounter [-] [75391] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:03:08 devstack cinder-volume[75391]: DEBUG oslo_service.periodic_task [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running periodic task VolumeManager._thread_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:03:08 devstack cinder-volume[75391]: DEBUG cinder.volume.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] thread count: 6 {{(pid=75391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:03:08 devstack cinder-volume[75391]: DEBUG cinder.volume.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] thread info: [<_MainThread(MainThread, started 135953583833216)>, , , , , ] {{(pid=75391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:04:08 devstack cinder-volume[75391]: DEBUG oslo_service.periodic_task [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:04:08 devstack cinder-volume[75391]: DEBUG cinder.volume.drivers.lvm [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Updating volume stats {{(pid=75391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 16:04:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:04:08 devstack sudo[78616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:04:08 devstack sudo[78616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:04:08 devstack sudo[78616]: pam_unix(sudo:session): session closed for user root Sep 16 16:04:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:04:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:04:08 devstack sudo[78623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:04:08 devstack sudo[78623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:04:09 devstack sudo[78623]: pam_unix(sudo:session): session closed for user root Sep 16 16:04:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:04:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:04:09 devstack sudo[78716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:04:09 devstack sudo[78716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:04:09 devstack sudo[78716]: pam_unix(sudo:session): session closed for user root Sep 16 16:04:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:04:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:04:09 devstack sudo[78842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:04:09 devstack sudo[78842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:04:09 devstack sudo[78842]: pam_unix(sudo:session): session closed for user root Sep 16 16:04:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:04:09 devstack cinder-volume[75391]: DEBUG cinder.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Notifying Schedulers of capabilities ... {{(pid=75391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:04:09 devstack cinder-volume[75391]: DEBUG oslo_service.periodic_task [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running periodic task VolumeManager._thread_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:04:09 devstack cinder-volume[75391]: DEBUG cinder.volume.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] thread count: 6 {{(pid=75391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:04:09 devstack cinder-volume[75391]: DEBUG cinder.volume.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] thread info: [<_MainThread(MainThread, started 135953583833216)>, , , , , ] {{(pid=75391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:05:03 devstack cinder-volume[75391]: DEBUG dbcounter [-] [75391] Writing DB stats cinder:SELECT=1 {{(pid=75391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:05:03 devstack cinder-volume[75391]: DEBUG dbcounter [-] [75391] Writing DB stats cinder:UPDATE=1 {{(pid=75391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:05:08 devstack cinder-volume[75391]: DEBUG oslo_service.periodic_task [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:05:08 devstack cinder-volume[75391]: DEBUG cinder.volume.drivers.lvm [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Updating volume stats {{(pid=75391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 16:05:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:05:08 devstack sudo[81831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:05:08 devstack sudo[81831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:05:08 devstack sudo[81831]: pam_unix(sudo:session): session closed for user root Sep 16 16:05:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:05:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:05:08 devstack sudo[81835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:05:08 devstack sudo[81835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:05:09 devstack sudo[81835]: pam_unix(sudo:session): session closed for user root Sep 16 16:05:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:05:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:05:09 devstack sudo[81845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:05:09 devstack sudo[81845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:05:09 devstack sudo[81845]: pam_unix(sudo:session): session closed for user root Sep 16 16:05:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:05:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:05:09 devstack sudo[81848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:05:09 devstack sudo[81848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:05:09 devstack sudo[81848]: pam_unix(sudo:session): session closed for user root Sep 16 16:05:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:05:09 devstack cinder-volume[75391]: DEBUG cinder.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Notifying Schedulers of capabilities ... {{(pid=75391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:05:09 devstack cinder-volume[75391]: DEBUG oslo_service.periodic_task [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running periodic task VolumeManager._thread_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:05:09 devstack cinder-volume[75391]: DEBUG cinder.volume.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] thread count: 6 {{(pid=75391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:05:09 devstack cinder-volume[75391]: DEBUG cinder.volume.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] thread info: [<_MainThread(MainThread, started 135953583833216)>, , , , , ] {{(pid=75391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:06:08 devstack cinder-volume[75391]: DEBUG oslo_service.periodic_task [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:06:08 devstack cinder-volume[75391]: DEBUG cinder.volume.drivers.lvm [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Updating volume stats {{(pid=75391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 16:06:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:06:08 devstack sudo[83952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:06:08 devstack sudo[83952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:06:08 devstack sudo[83952]: pam_unix(sudo:session): session closed for user root Sep 16 16:06:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:06:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:06:08 devstack sudo[83971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:06:08 devstack sudo[83971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:06:09 devstack sudo[83971]: pam_unix(sudo:session): session closed for user root Sep 16 16:06:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:06:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:06:09 devstack sudo[83979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:06:09 devstack sudo[83979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:06:09 devstack sudo[83979]: pam_unix(sudo:session): session closed for user root Sep 16 16:06:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:06:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:06:09 devstack sudo[83994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:06:09 devstack sudo[83994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:06:09 devstack sudo[83994]: pam_unix(sudo:session): session closed for user root Sep 16 16:06:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:06:09 devstack cinder-volume[75391]: DEBUG cinder.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Notifying Schedulers of capabilities ... {{(pid=75391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:07:03 devstack cinder-volume[75391]: DEBUG dbcounter [-] [75391] Writing DB stats cinder:SELECT=1 {{(pid=75391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:07:03 devstack cinder-volume[75391]: DEBUG dbcounter [-] [75391] Writing DB stats cinder:UPDATE=1 {{(pid=75391) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:07:08 devstack cinder-volume[75391]: DEBUG oslo_service.periodic_task [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:07:08 devstack cinder-volume[75391]: DEBUG cinder.volume.drivers.lvm [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Updating volume stats {{(pid=75391) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 16 16:07:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:08 devstack sudo[85070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 16:07:08 devstack sudo[85070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:08 devstack sudo[85070]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:08 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:08 devstack sudo[85073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:07:08 devstack sudo[85073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:09 devstack sudo[85073]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:09 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 16:07:09 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:09 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:09 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 16:07:09 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:09 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:09 devstack cinder-volume[75391]: DEBUG oslo_concurrency.processutils [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75391) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:09 devstack cinder-volume[75391]: DEBUG cinder.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Notifying Schedulers of capabilities ... {{(pid=75391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:07:09 devstack cinder-volume[75391]: DEBUG oslo_service.periodic_task [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] Running periodic task VolumeManager._thread_info {{(pid=75391) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:07:09 devstack cinder-volume[75391]: DEBUG cinder.volume.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] thread count: 6 {{(pid=75391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:07:09 devstack cinder-volume[75391]: DEBUG cinder.volume.manager [None req-e0788b64-e63c-4a79-8aa8-82726fae95b5 None None] thread info: [<_MainThread(MainThread, started 135953583833216)>, , , , , ] {{(pid=75391) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:07:16 devstack cinder-volume[75235]: INFO oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Caught SIGTERM, stopping children Sep 16 16:07:16 devstack cinder-volume[75235]: DEBUG oslo_concurrency.lockutils [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Acquiring lock "singleton_lock" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 16:07:16 devstack cinder-volume[75235]: DEBUG oslo_concurrency.lockutils [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Acquired lock "singleton_lock" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 16:07:16 devstack cinder-volume[75235]: DEBUG oslo_concurrency.lockutils [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Releasing lock "singleton_lock" {{(pid=75235) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 16:07:16 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Stop services. {{(pid=75235) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 16 16:07:16 devstack cinder-volume[75235]: DEBUG oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Killing children. {{(pid=75235) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 16 16:07:16 devstack cinder-volume[75235]: INFO oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Waiting on 1 children to exit Sep 16 16:07:17 devstack cinder-volume[75391]: DEBUG oslo_concurrency.lockutils [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Acquiring lock "singleton_lock" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 16:07:17 devstack cinder-volume[75391]: DEBUG oslo_concurrency.lockutils [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Acquired lock "singleton_lock" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 16:07:17 devstack cinder-volume[75391]: DEBUG oslo_concurrency.lockutils [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Releasing lock "singleton_lock" {{(pid=75391) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 16:07:17 devstack cinder-volume[75391]: WARNING amqp [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 16:07:17 devstack cinder-volume[75391]: WARNING amqp [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 16:07:17 devstack cinder-volume[75235]: INFO oslo_service.backend._eventlet.service [None req-1b73ff23-edc3-438a-8f2f-008d0a6e1c8c None None] Child 75391 exited with status 0 Sep 16 16:07:17 devstack cinder-volume[85388]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 16 16:07:17 devstack cinder-volume[85388]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 16:07:17 devstack cinder-volume[85388]: we strongly recommend against using it for new projects. Sep 16 16:07:17 devstack cinder-volume[85388]: If you are already using Eventlet, we recommend migrating to a different Sep 16 16:07:17 devstack cinder-volume[85388]: framework. For more detail see Sep 16 16:07:17 devstack cinder-volume[85388]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 16:07:17 devstack cinder-volume[85388]: import eventlet # noqa Sep 16 16:07:19 devstack cinder-volume[85388]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 16:07:19 devstack cinder-volume[85388]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 16:07:19 devstack cinder-volume[85388]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 16:07:20 devstack cinder-volume[85388]: INFO dbcounter [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Registered counter for database cinder Sep 16 16:07:20 devstack cinder-volume[85388]: DEBUG oslo_db.sqlalchemy.engines [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG dbcounter [-] [85388] Writer thread running {{(pid=85388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 16:07:21 devstack cinder-volume[85388]: INFO cinder.rpc [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 16:07:21 devstack cinder-volume[85388]: INFO cinder.rpc [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_db.sqlalchemy.engines [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:07:21 devstack cinder-volume[85388]: INFO cinder.volume.manager [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Determined volume DB was empty at startup. Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG cinder.volume.manager [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85388) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 16 16:07:21 devstack cinder-volume[85388]: INFO cinder.volume.manager [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 16:07:21 devstack cinder-volume[85388]: WARNING stevedore.named [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 16:07:21 devstack cinder-volume[85388]: WARNING castellan.key_manager [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 16:07:21 devstack cinder-volume[85388]: WARNING cinder.keymgr.conf_key_mgr [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 16:07:21 devstack cinder-volume[85388]: INFO cinder.volume.manager [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_db.sqlalchemy.engines [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:07:21 devstack cinder-volume[85388]: INFO oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Starting 1 workers Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Started child 85600 {{(pid=85388) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Full set of CONF: {{(pid=85388) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] ******************************************************************************** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Configuration options gathered from: {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] ================================================================================ {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] allow_availability_zone_fallback = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] allow_compression_on_image_upload = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] allowed_direct_url_schemes = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] api_rate_limit = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] auth_strategy = keystone {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_availability_zone = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_host = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_stats_polling_interval = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backup_api_class = cinder.backup.api.API {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backup_name_template = backup-%s {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backup_use_same_host = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backup_use_temp_snapshot = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] chap_password = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] chap_username = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cinder_internal_tenant_project_id = c590631f10dc4f3c8688f85649a6fc27 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cinder_internal_tenant_user_id = a0594d4867714b1babbcffbc0563cbc1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cluster = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] compression_format = gzip {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] compute_api_class = cinder.compute.nova.API {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] config_dir = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] config_source = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85600]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] control_exchange = openstack {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] debug = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] default_availability_zone = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] default_group_type = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] default_volume_type = QuobyteHD {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] disk_geometry = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] driver_client_cert = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] driver_client_cert_key = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] driver_data_namespace = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] driver_ssl_cert_path = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] driver_ssl_cert_verify = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] driver_use_ssl = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] enable_new_services = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] enable_unsupported_driver = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] enabled_backends = ['QuobyteHD'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] enforce_multipath_for_image_xfer = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] filter_function = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_api_insecure = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_api_ssl_compression = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_ca_certificates_file = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_catalog_info = image:glance:publicURL {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_certfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_keyfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_num_retries = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance_request_timeout = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] goodness_function = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] graceful_shutdown_timeout = 5 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] group_api_class = cinder.group.api.API {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] host = devstack {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_compress_on_upload = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_conversion_address_space_limit = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_conversion_cpu_limit = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_conversion_disable = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_introspection_address_space_limit = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_introspection_cpu_limit = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_upload_use_cinder_backend = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_upload_use_internal_tenant = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_volume_cache_enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_volume_cache_max_count = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] image_volume_cache_max_size_gb = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] init_host_max_objects_retrieval = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] instance_format = [instance: %(uuid)s] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] iscsi_target_flags = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] iscsi_write_cache = on {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] iser_helper = tgtadm {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] iser_ip_address = 192.168.122.229 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] iser_port = 3260 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] log_color = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] log_config_append = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] log_dir = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] log_file = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] log_options = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] log_rotate_interval = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] log_rotate_interval_type = days {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] log_rotation_type = none {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] max_age = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] max_logfile_count = 30 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] max_logfile_size_mb = 200 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] max_over_subscription_ratio = 20.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] message_reap_interval = 86400 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] message_ttl = 2592000 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] migration_create_volume_timeout_secs = 300 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] monkey_patch = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] monkey_patch_modules = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] my_ip = 192.168.122.229 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] no_snapshot_gb_quota = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] num_iser_scan_tries = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] num_shell_tries = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] num_volume_device_scan_tries = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] nvmeof_conn_info_version = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] nvmet_ns_id = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] nvmet_port_id = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] osapi_max_limit = 1000 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] osapi_volume_ext_list = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] osapi_volume_listen = 0.0.0.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] osapi_volume_listen_port = 8776 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] osapi_volume_use_ssl = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] osapi_volume_workers = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] per_volume_size_limit = -1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] periodic_fuzzy_delay = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] periodic_interval = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] project_id_regex = [0-9a-f\-]+ {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] public_endpoint = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] publish_errors = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] quota_backup_gigabytes = 1000 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] quota_backups = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] quota_gigabytes = 1000 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] quota_groups = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] quota_snapshots = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] quota_volumes = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] rate_limit_burst = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] rate_limit_except_level = CRITICAL {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] rate_limit_interval = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] reinit_driver_count = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] replication_device = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] report_discard_supported = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] report_interval = 120 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] reservation_clean_interval = 86400 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] reservation_expire = 86400 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] reserved_image_namespaces = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] reserved_percentage = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] rpc_response_timeout = 120 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] run_external_periodic_tasks = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] scst_target_driver = iscsi {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] scst_target_iqn_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_down_time = 720 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] shell_completion = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] snapshot_name_template = snapshot-%s {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] split_loggers = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] state_path = /opt/stack/data/cinder {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] storage_availability_zone = nova {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] storage_protocol = iSCSI {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] syslog_log_facility = LOG_USER {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] target_helper = lioadm {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] target_ip_address = 192.168.122.229 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] target_port = 3260 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] target_protocol = iscsi {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] target_secondary_ip_addresses = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] trace_flags = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] transfer_api_class = cinder.transfer.api.API {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] transport_url = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] until_refresh = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] use_chap_auth = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] use_default_quota_class = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] use_journal = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] use_json = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] use_multipath_for_image_xfer = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] use_stderr = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] use_syslog = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] verify_glance_signatures = enabled {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_api_class = cinder.volume.api.API {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_backend_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_clear = zero {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_clear_ionice = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_clear_size = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_copy_bps_limit = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_dd_blocksize = 1M {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_name_template = volume-%s {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_service_inithost_offload = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volume_usage_audit_period = month {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] zoning_mode = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_concurrency.disable_process_locking = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.auth_section = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.auth_type = password {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.auth_version = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.cache = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.certfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.include_service_catalog = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.insecure = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.interface = public {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.keyfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_password = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcache_username = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.region_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.service_type = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.backend = dogpile.cache.null {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.backend_argument = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.backend_expiration_time = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.config_prefix = cache.oslo {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.debug_cache_backend = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.enable_retry_client = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.enable_socket_keepalive = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.expiration_time = 600 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.hashclient_retry_attempts = 2 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.memcache_dead_retry = 300 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.memcache_pool_maxsize = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.memcache_sasl_enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.password = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.proxies = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.redis_db = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.redis_server = localhost:6379 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.retry_attempts = 2 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.retry_delay = 0.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.socket_keepalive_count = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.socket_keepalive_idle = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.socket_keepalive_interval = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.socket_timeout = 1.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.tls_allowed_ciphers = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.tls_cafile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.tls_certfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.tls_enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.tls_keyfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cache.username = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85600]: INFO cinder.volume.manager [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] coordination.backend_url = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.asyncio_connection = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.asyncio_slave_connection = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.backend = sqlalchemy {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.connection = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.connection_debug = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.connection_parameters = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.connection_recycle_time = 3600 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.remotefs [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85600) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.connection_trace = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.db_inc_retry_interval = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.db_max_retries = 20 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.db_max_retry_interval = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.db_retry_interval = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.max_overflow = 50 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.max_pool_size = 5 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.max_retries = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.mysql_wsrep_sync_wait = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.pool_timeout = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.retry_interval = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.slave_connection = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.sqlite_synchronous = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.synchronous_reader = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] database.use_db_reconnect = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_tracing.insecure = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.connection_string = messaging:// {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.es_doc_type = notification {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.es_scroll_size = 10000 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.es_scroll_time = 2m {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.filter_error_trace = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.hmac_keys = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.sentinel_service_name = mymaster {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.socket_timeout = 0.1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.trace_requests = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler.trace_sqlalchemy = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler_jaeger.process_tags = {} {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler_jaeger.service_name_prefix = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] profiler_otlp.service_name_prefix = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.enforce_new_defaults = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.policy_default_rule = default {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.policy_file = policy.yaml {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_policy.remote_timeout = 60.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] privsep_osbrick.group = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] privsep_osbrick.helper_command = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] privsep_osbrick.user = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cinder_sys_admin.group = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cinder_sys_admin.helper_command = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] cinder_sys_admin.user = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.auth_section = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.auth_type = password {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.cafile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.certfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.collect_timing = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.insecure = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.keyfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.send_service_user_token = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.split_loggers = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.timeout = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.tls_ciphers = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] service_user.tls_min_version = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.auth_section = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.auth_type = password {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.certfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.collect_timing = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.insecure = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.keyfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.region_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.split_loggers = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.timeout = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.tls_ciphers = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] glance.tls_min_version = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.backend_availability_zone = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.chap_password = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.chap_username = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.disk_geometry = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.driver_client_cert = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.driver_client_cert_key = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.driver_data_namespace = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.driver_use_ssl = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.extra_capabilities = {} {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.filter_function = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.goodness_function = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.iscsi_target_flags = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.iscsi_write_cache = on {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.iser_helper = tgtadm {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.iser_port = 3260 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_host = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_login = admin {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_mount_options = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_password = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_private_key = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_share_path = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_ssh_port = 22 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.num_shell_tries = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.quobyte_volume_url = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.replication_device = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.report_discard_supported = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.reserved_percentage = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.target_helper = tgtadm {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.target_port = 3260 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.target_protocol = iscsi {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.trace_flags = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.unique_fqdn_network = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.use_chap_auth = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.volume_backend_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.volume_clear = zero {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.volume_clear_ionice = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.volume_clear_size = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_reports.file_event_handler = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_reports.log_dir = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.backend_availability_zone = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.backend_host = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.chap_password = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.chap_username = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.chiscsi_conf = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.disk_geometry = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.driver_client_cert = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.driver_data_namespace = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.driver_use_ssl = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.extra_capabilities = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.filter_function = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.goodness_function = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.iscsi_target_flags = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.iscsi_write_cache = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.iser_helper = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.iser_ip_address = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.iser_port = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.iser_target_prefix = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_host = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_login = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_mount_options = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_password = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_private_key = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_share_path = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_ssh_port = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.num_shell_tries = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85600) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nvmet_ns_id = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85600]: WARNING cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.nvmet_port_id = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.replication_device = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.report_discard_supported = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.reserved_percentage = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.scst_target_driver = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85600]: WARNING cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.storage_protocol = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.target_helper = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.target_ip_address = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Running cmd (subprocess): mount.quobyte {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.target_port = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.target_prefix = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.target_protocol = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.trace_flags = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.unique_fqdn_network = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.use_chap_auth = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.volume_clear = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.volume_clear_ionice = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.volume_clear_size = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] QuobyteHD.volumes_dir = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.ssl = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.ssl_version = {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_notifications.driver = [] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_notifications.retry = -1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] key_manager.fixed_key = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.barbican_api_version = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.barbican_endpoint = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.barbican_endpoint_type = public {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.barbican_region_name = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.cafile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.certfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.collect_timing = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.insecure = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.keyfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.number_of_retries = 60 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.retry_delay = 1 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.send_service_user_token = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.split_loggers = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.timeout = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.tls_ciphers = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.tls_min_version = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.verify_ssl = True {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican.verify_ssl_path = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.auth_section = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.auth_type = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.cafile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.certfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.collect_timing = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.insecure = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.keyfile = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.split_loggers = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.timeout = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.tls_ciphers = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] barbican_service_user.tls_min_version = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.approle_role_id = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.approle_secret_id = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.auth_method = approle {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.auth_path = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.kv_mountpoint = secret {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.kv_path = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.kv_version = 2 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.namespace = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.root_token_id = **** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.ssl_ca_crt_file = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.timeout = 60.0 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.token_file = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.token_role = None {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.use_ssl = False {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:21 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] ******************************************************************************** {{(pid=85388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 16 16:07:21 devstack quobyte-client[85605]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 16:07:21 devstack quobyte-client[85605]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 16 16:07:21 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:21 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:07:21 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:07:21 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=85600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:07:21 devstack cinder-volume[85600]: INFO cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef ... Sep 16 16:07:21 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 -c /etc/quobyte/client-cinder.cfg {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:21 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 -c /etc/quobyte/client-cinder.cfg Sep 16 16:07:21 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:22 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.462s {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:22 devstack cinder-volume[85600]: INFO cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef succeeded Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=85600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.479s {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:22 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:07:22 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:22 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.290s {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:22 devstack cinder-volume[85600]: INFO cinder.volume.driver [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Driver hasn't implemented _init_vendor_properties() Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG cinder.volume.driver [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85600) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG oslo_db.sqlalchemy.engines [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG dbcounter [-] [85600] Writer thread running {{(pid=85600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG cinder.db.api [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Building query based on filter {{(pid=85600) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG cinder.image.image_utils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85600) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 16 16:07:22 devstack cinder-volume[85600]: INFO cinder.keymgr.migration [None req-8c5c3d34-714e-4545-8684-773b01fc65d5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=85600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=85600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:07:22 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:22 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:07:22 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:23 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.264s {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG cinder.manager [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Notifying Schedulers of capabilities ... {{(pid=85600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:07:23 devstack cinder-volume[85600]: INFO cinder.volume.manager [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Driver initialization completed successfully. Sep 16 16:07:23 devstack cinder-volume[85600]: INFO cinder.manager [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Initiating service 3 cleanup Sep 16 16:07:23 devstack cinder-volume[85600]: INFO cinder.manager [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Service 3 cleanup completed. Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG cinder.service [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Creating RPC server for service cinder-volume {{(pid=85600) start /opt/stack/cinder/cinder/service.py:231}} Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG cinder.service [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85600) start /opt/stack/cinder/cinder/service.py:237}} Sep 16 16:07:23 devstack cinder-volume[85600]: INFO cinder.volume.manager [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=85600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.quobyte [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=85600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:23 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:07:23 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:23 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:23 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.261s {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:23 devstack cinder-volume[85600]: INFO cinder.volume.manager [None req-7ae3242d-334a-4ae8-8f7f-0a937eac927d None None] Driver post RPC initialization completed successfully. Sep 16 16:07:27 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-417d8187-0fc8-4770-80de-a747572980dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:07:27 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-417d8187-0fc8-4770-80de-a747572980dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:07:27 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.quobyte [None req-417d8187-0fc8-4770-80de-a747572980dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=85600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:07:27 devstack cinder-volume[85600]: DEBUG cinder.volume.drivers.quobyte [None req-417d8187-0fc8-4770-80de-a747572980dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=85600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:07:27 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-417d8187-0fc8-4770-80de-a747572980dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85600) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:07:27 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-417d8187-0fc8-4770-80de-a747572980dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:27 devstack sudo[85895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:07:27 devstack sudo[85895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:27 devstack cinder-volume[85388]: INFO oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Caught SIGTERM, stopping children Sep 16 16:07:27 devstack cinder-volume[85388]: DEBUG oslo_concurrency.lockutils [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Acquiring lock "singleton_lock" {{(pid=85388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 16:07:27 devstack cinder-volume[85388]: DEBUG oslo_concurrency.lockutils [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Acquired lock "singleton_lock" {{(pid=85388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 16:07:27 devstack cinder-volume[85388]: DEBUG oslo_concurrency.lockutils [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Releasing lock "singleton_lock" {{(pid=85388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 16:07:27 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Stop services. {{(pid=85388) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 16 16:07:27 devstack cinder-volume[85388]: DEBUG oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Killing children. {{(pid=85388) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 16 16:07:27 devstack cinder-volume[85388]: INFO oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Waiting on 1 children to exit Sep 16 16:07:27 devstack sudo[85895]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:27 devstack cinder-volume[85600]: DEBUG oslo_concurrency.processutils [None req-417d8187-0fc8-4770-80de-a747572980dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.260s {{(pid=85600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:27 devstack cinder-volume[85600]: DEBUG cinder.manager [None req-417d8187-0fc8-4770-80de-a747572980dc None None] Notifying Schedulers of capabilities ... {{(pid=85600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:07:31 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Acquiring lock "singleton_lock" {{(pid=85600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 16:07:31 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Acquired lock "singleton_lock" {{(pid=85600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 16:07:31 devstack cinder-volume[85600]: DEBUG oslo_concurrency.lockutils [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Releasing lock "singleton_lock" {{(pid=85600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 16:07:31 devstack cinder-volume[85600]: WARNING amqp [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 16:07:31 devstack cinder-volume[85600]: WARNING amqp [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 16:07:31 devstack cinder-volume[85388]: INFO oslo_service.backend._eventlet.service [None req-d4053aca-aac0-49ce-ad93-9ae75af49f1c None None] Child 85600 exited with status 0 Sep 16 16:07:32 devstack cinder-volume[85951]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 16 16:07:32 devstack cinder-volume[85951]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 16:07:32 devstack cinder-volume[85951]: we strongly recommend against using it for new projects. Sep 16 16:07:32 devstack cinder-volume[85951]: If you are already using Eventlet, we recommend migrating to a different Sep 16 16:07:32 devstack cinder-volume[85951]: framework. For more detail see Sep 16 16:07:32 devstack cinder-volume[85951]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 16:07:32 devstack cinder-volume[85951]: import eventlet # noqa Sep 16 16:07:35 devstack cinder-volume[85951]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 16 16:07:35 devstack cinder-volume[85951]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 16 16:07:35 devstack cinder-volume[85951]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85951) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 16 16:07:35 devstack cinder-volume[85951]: INFO dbcounter [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Registered counter for database cinder Sep 16 16:07:35 devstack cinder-volume[85951]: DEBUG oslo_db.sqlalchemy.engines [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG dbcounter [-] [85951] Writer thread running {{(pid=85951) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 16:07:36 devstack cinder-volume[85951]: INFO cinder.rpc [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 16:07:36 devstack cinder-volume[85951]: INFO cinder.rpc [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_db.sqlalchemy.engines [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:07:36 devstack cinder-volume[85951]: INFO cinder.volume.manager [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Determined volume DB was empty at startup. Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG cinder.volume.manager [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85951) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 16 16:07:36 devstack cinder-volume[85951]: WARNING stevedore.named [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 16:07:36 devstack cinder-volume[85951]: WARNING castellan.key_manager [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 16:07:36 devstack cinder-volume[85951]: WARNING cinder.keymgr.conf_key_mgr [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 16:07:36 devstack cinder-volume[85951]: INFO cinder.volume.manager [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_db.sqlalchemy.engines [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85951) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:07:36 devstack cinder-volume[85951]: INFO oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Starting 1 workers Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Started child 86255 {{(pid=85951) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Full set of CONF: {{(pid=85951) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] ******************************************************************************** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] Configuration options gathered from: {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] ================================================================================ {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 16 16:07:36 devstack cinder-volume[86255]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] allow_availability_zone_fallback = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] allow_compression_on_image_upload = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] allowed_direct_url_schemes = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] api_rate_limit = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] auth_strategy = keystone {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_availability_zone = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_host = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_stats_polling_interval = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backup_api_class = cinder.backup.api.API {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backup_name_template = backup-%s {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backup_use_same_host = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backup_use_temp_snapshot = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] chap_password = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] chap_username = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cinder_internal_tenant_project_id = c590631f10dc4f3c8688f85649a6fc27 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cinder_internal_tenant_user_id = a0594d4867714b1babbcffbc0563cbc1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cluster = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] compression_format = gzip {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] compute_api_class = cinder.compute.nova.API {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] config_dir = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] config_source = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] control_exchange = openstack {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] debug = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] default_availability_zone = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] default_group_type = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] default_volume_type = QuobyteHD {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] disk_geometry = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] driver_client_cert = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] driver_client_cert_key = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] driver_data_namespace = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] driver_ssl_cert_path = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] driver_ssl_cert_verify = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] driver_use_ssl = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] enable_new_services = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] enable_unsupported_driver = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] enabled_backends = ['QuobyteHD'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] enforce_multipath_for_image_xfer = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] filter_function = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_api_insecure = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_api_ssl_compression = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_ca_certificates_file = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_catalog_info = image:glance:publicURL {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_certfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_keyfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_num_retries = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance_request_timeout = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] goodness_function = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] graceful_shutdown_timeout = 5 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] group_api_class = cinder.group.api.API {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] host = devstack {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_compress_on_upload = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_conversion_address_space_limit = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_conversion_cpu_limit = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_conversion_disable = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_introspection_address_space_limit = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_introspection_cpu_limit = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_upload_use_cinder_backend = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_upload_use_internal_tenant = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_volume_cache_enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_volume_cache_max_count = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] init_host_max_objects_retrieval = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] instance_format = [instance: %(uuid)s] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] iscsi_target_flags = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] iscsi_write_cache = on {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] iser_helper = tgtadm {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] iser_ip_address = 192.168.122.229 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] iser_port = 3260 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] log_color = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] log_config_append = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] log_dir = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] log_file = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] log_options = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] log_rotate_interval = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] log_rotate_interval_type = days {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Starting volume driver QuobyteDriver (1.2.1) Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] log_rotation_type = none {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86255) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] max_age = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] max_logfile_count = 30 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] max_logfile_size_mb = 200 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] max_over_subscription_ratio = 20.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] message_reap_interval = 86400 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] message_ttl = 2592000 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] monkey_patch = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] monkey_patch_modules = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] my_ip = 192.168.122.229 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] no_snapshot_gb_quota = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] num_iser_scan_tries = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] num_shell_tries = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] num_volume_device_scan_tries = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] nvmeof_conn_info_version = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] nvmet_ns_id = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] nvmet_port_id = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] osapi_max_limit = 1000 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] osapi_volume_ext_list = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] osapi_volume_listen_port = 8776 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] osapi_volume_use_ssl = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] osapi_volume_workers = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] per_volume_size_limit = -1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] periodic_fuzzy_delay = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] periodic_interval = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] public_endpoint = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] publish_errors = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] quota_backup_gigabytes = 1000 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] quota_backups = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] quota_gigabytes = 1000 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] quota_groups = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] quota_snapshots = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] quota_volumes = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] rate_limit_burst = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] rate_limit_except_level = CRITICAL {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] rate_limit_interval = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] reinit_driver_count = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] replication_device = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] report_discard_supported = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] report_interval = 120 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] reservation_clean_interval = 86400 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] reservation_expire = 86400 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] reserved_image_namespaces = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] reserved_percentage = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] rpc_response_timeout = 120 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] run_external_periodic_tasks = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] scst_target_driver = iscsi {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] scst_target_iqn_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_down_time = 720 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] shell_completion = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] snapshot_name_template = snapshot-%s {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] split_loggers = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] state_path = /opt/stack/data/cinder {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] storage_availability_zone = nova {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] storage_protocol = iSCSI {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] syslog_log_facility = LOG_USER {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] target_helper = lioadm {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] target_ip_address = 192.168.122.229 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] target_port = 3260 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] target_protocol = iscsi {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] target_secondary_ip_addresses = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] trace_flags = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] transport_url = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] until_refresh = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] use_chap_auth = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] use_default_quota_class = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] use_journal = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] use_json = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] use_multipath_for_image_xfer = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] use_stderr = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] use_syslog = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] verify_glance_signatures = enabled {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_api_class = cinder.volume.api.API {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_backend_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_clear = zero {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_clear_ionice = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_clear_size = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_copy_bps_limit = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_dd_blocksize = 1M {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_name_template = volume-%s {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_service_inithost_offload = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volume_usage_audit_period = month {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] zoning_mode = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.auth_section = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.auth_type = password {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.auth_version = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.cache = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.certfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.insecure = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.interface = public {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.keyfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_password = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcache_username = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.region_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.service_type = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.backend = dogpile.cache.null {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.backend_argument = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.backend_expiration_time = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.config_prefix = cache.oslo {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.debug_cache_backend = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.enable_retry_client = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.enable_socket_keepalive = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.expiration_time = 600 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.memcache_dead_retry = 300 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.memcache_pool_maxsize = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86255) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.memcache_sasl_enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.quobyte [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.quobyte [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.password = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.proxies = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.redis_db = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Running cmd (subprocess): mount.quobyte {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.redis_server = localhost:6379 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.retry_attempts = 2 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.retry_delay = 0.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.socket_keepalive_count = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.socket_keepalive_idle = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.socket_keepalive_interval = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.socket_timeout = 1.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.tls_allowed_ciphers = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.tls_cafile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.tls_certfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.tls_enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.tls_keyfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cache.username = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] coordination.backend_url = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.asyncio_connection = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.asyncio_slave_connection = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.backend = sqlalchemy {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.connection = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.connection_debug = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.connection_parameters = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.connection_recycle_time = 3600 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.connection_trace = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.db_inc_retry_interval = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.db_max_retries = 20 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.db_max_retry_interval = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.db_retry_interval = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.max_overflow = 50 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.max_pool_size = 5 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.max_retries = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.pool_timeout = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.retry_interval = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.slave_connection = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.sqlite_synchronous = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.synchronous_reader = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] database.use_db_reconnect = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_tracing.insecure = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.connection_string = messaging:// {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.es_doc_type = notification {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.es_scroll_size = 10000 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.es_scroll_time = 2m {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.filter_error_trace = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.hmac_keys = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.sentinel_service_name = mymaster {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.socket_timeout = 0.1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.trace_requests = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler.trace_sqlalchemy = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler_jaeger.process_tags = {} {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] profiler_otlp.service_name_prefix = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.enforce_new_defaults = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.policy_default_rule = default {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.policy_file = policy.yaml {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] privsep_osbrick.group = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] privsep_osbrick.helper_command = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] privsep_osbrick.user = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cinder_sys_admin.group = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cinder_sys_admin.helper_command = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] cinder_sys_admin.user = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.auth_section = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.auth_type = password {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.cafile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.certfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.collect_timing = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.insecure = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.keyfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.send_service_user_token = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.split_loggers = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.timeout = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.tls_ciphers = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] service_user.tls_min_version = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.auth_section = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.auth_type = password {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.certfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.collect_timing = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.insecure = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.keyfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.region_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.split_loggers = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.timeout = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.tls_ciphers = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] glance.tls_min_version = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.backend_availability_zone = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.chap_password = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.chap_username = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.disk_geometry = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.driver_client_cert = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.driver_data_namespace = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.driver_use_ssl = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.extra_capabilities = {} {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.filter_function = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.goodness_function = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.iscsi_target_flags = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.iser_helper = tgtadm {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.iser_port = 3260 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_host = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_login = admin {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_mount_options = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_password = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_private_key = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_share_path = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack quobyte-client[86256]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 16:07:36 devstack quobyte-client[86256]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.quobyte_volume_url = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.replication_device = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.report_discard_supported = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.target_helper = tgtadm {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.target_port = 3260 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.target_protocol = iscsi {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.trace_flags = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.use_chap_auth = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.volume_backend_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.volume_clear = zero {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_reports.file_event_handler = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_reports.log_dir = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.backend_availability_zone = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.backend_host = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.chap_password = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.chap_username = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.chiscsi_conf = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.disk_geometry = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.driver_client_cert = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.driver_data_namespace = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.driver_use_ssl = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.extra_capabilities = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.filter_function = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.goodness_function = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.iser_helper = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.iser_ip_address = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.iser_port = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.iser_target_prefix = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_host = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_login = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_mount_options = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_password = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_private_key = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_share_path = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_ssh_port = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.num_shell_tries = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.nvmet_port_id = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.replication_device = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.report_discard_supported = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.reserved_percentage = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.scst_target_driver = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.storage_protocol = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.target_helper = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.target_ip_address = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.target_port = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.target_prefix = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.target_protocol = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.trace_flags = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.use_chap_auth = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.volume_clear = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.volume_clear_size = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] QuobyteHD.volumes_dir = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.ssl = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_notifications.driver = [] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] key_manager.fixed_key = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.barbican_api_version = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.barbican_endpoint = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.barbican_endpoint_type = public {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.barbican_region_name = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.cafile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.certfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.collect_timing = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.insecure = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.keyfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.number_of_retries = 60 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.retry_delay = 1 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.send_service_user_token = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.split_loggers = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.timeout = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.tls_ciphers = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.tls_min_version = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.verify_ssl = True {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican.verify_ssl_path = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.auth_section = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.auth_type = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.cafile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.certfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.collect_timing = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.insecure = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.keyfile = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.split_loggers = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.timeout = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.tls_ciphers = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] barbican_service_user.tls_min_version = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.approle_role_id = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.approle_secret_id = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.auth_method = approle {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.auth_path = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.kv_mountpoint = secret {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.kv_path = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.kv_version = 2 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.namespace = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.root_token_id = **** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.ssl_ca_crt_file = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.timeout = 60.0 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.token_file = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.token_role = None {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.use_ssl = False {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 16 16:07:36 devstack cinder-volume[85951]: DEBUG oslo_service.backend._eventlet.service [None req-f6683a7d-fa1d-451d-b0a6-91a4b403a2d3 None None] ******************************************************************************** {{(pid=85951) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 16 16:07:36 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.247s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:36 devstack cinder-volume[86255]: INFO cinder.volume.driver [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Driver hasn't implemented _init_vendor_properties() Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG cinder.volume.driver [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86255) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG oslo_db.sqlalchemy.engines [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86255) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 16 16:07:36 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writer thread running {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG cinder.db.api [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Building query based on filter {{(pid=86255) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86255) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:37 devstack cinder-volume[86255]: INFO cinder.keymgr.migration [None req-d801934a-e81c-4545-b8be-5171ce16499a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 16:07:37 devstack sudo[86268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:07:37 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:37 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.235s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:07:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Driver initialization completed successfully. Sep 16 16:07:37 devstack cinder-volume[86255]: INFO cinder.manager [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Initiating service 3 cleanup Sep 16 16:07:37 devstack cinder-volume[86255]: INFO cinder.manager [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Service 3 cleanup completed. Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG cinder.service [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Creating RPC server for service cinder-volume {{(pid=86255) start /opt/stack/cinder/cinder/service.py:231}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG cinder.service [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86255) start /opt/stack/cinder/cinder/service.py:237}} Sep 16 16:07:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:07:37 devstack sudo[86282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:07:37 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:07:37 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root Sep 16 16:07:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.247s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:07:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-160863e7-ffc6-40a0-b269-7382c0fad6fb None None] Driver post RPC initialization completed successfully. Sep 16 16:07:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:07:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 6 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:07:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:07:46 devstack cinder-volume[85951]: DEBUG dbcounter [-] [85951] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85951) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:07:47 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:07:47 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=2 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:08:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:08:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:08:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:08:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:08:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:08:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:08:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:08:41 devstack sudo[86961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:08:41 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:08:42 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root Sep 16 16:08:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.547s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:08:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:08:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:08:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 6 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:08:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Flow 'volume_create_manager' (54fef0e0-903d-43bb-a0f5-e7a4c8259d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8272092a-8fd6-4356-99d9-726d7d819a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8272092a-8fd6-4356-99d9-726d7d819a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-677053486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5075cbbb-1305-4d94-8c83-af91cb945607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58926dae9c134c88b706d09568078b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:08:57Z,use_quota=True,user_id='43b325c7fb1f49fba5d910a1477a7a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa9b1ba-f11f-425c-83ef-3556a2084abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa9b1ba-f11f-425c-83ef-3556a2084abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0beffd-fe60-44ff-b3fb-1bc54c6b73f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0beffd-fe60-44ff-b3fb-1bc54c6b73f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5075cbbb-1305-4d94-8c83-af91cb945607', 'volume_name': 'volume-5075cbbb-1305-4d94-8c83-af91cb945607', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f744009-5aa5-4d01-ad91-2311c80d6f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f744009-5aa5-4d01-ad91-2311c80d6f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d90776-9c8a-4b08-b8dd-855ff89232f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:08:57 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Volume 5075cbbb-1305-4d94-8c83-af91cb945607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5075cbbb-1305-4d94-8c83-af91cb945607', 'volume_size': 1} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-677053486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5075cbbb-1305-4d94-8c83-af91cb945607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58926dae9c134c88b706d09568078b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:08:57Z,use_quota=True,user_id='43b325c7fb1f49fba5d910a1477a7a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Creating volume 5075cbbb-1305-4d94-8c83-af91cb945607 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:08:57 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:08:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:08:58 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607 1073741824 Sep 16 16:08:58 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:08:59 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Sep 16 16:08:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607 1073741824" returned: 0 in 1.352s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:08:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:08:59 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607 Sep 16 16:08:59 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:00 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607" returned: 0 in 0.708s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] <== create_volume: return (2177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:09:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d90776-9c8a-4b08-b8dd-855ff89232f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5075cbbb-1305-4d94-8c83-af91cb945607', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14587e56-0871-46a3-8f3f-c32b17e49f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:00 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Volume volume-5075cbbb-1305-4d94-8c83-af91cb945607 (5075cbbb-1305-4d94-8c83-af91cb945607): created successfully Sep 16 16:09:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14587e56-0871-46a3-8f3f-c32b17e49f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Flow 'volume_create_manager' (54fef0e0-903d-43bb-a0f5-e7a4c8259d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:09:00 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-aaee07af-a40b-49e5-8b72-370c4f145038 tempest-DeleteServersTestJSON-913252069 None] Created volume successfully. Sep 16 16:09:02 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Flow 'volume_create_manager' (1bcba09d-1d23-4831-a9b5-ab9f212756fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38307a-3d0a-4efe-a964-d3d6fae037e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac38307a-3d0a-4efe-a964-d3d6fae037e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1980159633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7176aa9385c24356858c5efbfc1aa1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:03Z,use_quota=True,user_id='adfa9fea3ca5452da28ee863110b065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e011661-a3b6-4277-b00c-08da29752d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e011661-a3b6-4277-b00c-08da29752d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af18125-9aef-407c-aa84-07260e545b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af18125-9aef-407c-aa84-07260e545b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3', 'volume_name': 'volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5789c675-3277-46e5-9ca6-087711c922db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5789c675-3277-46e5-9ca6-087711c922db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935f9e08-8356-4e39-bba8-b58e5c792910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:03 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Volume 6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3', 'volume_size': 1} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1980159633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7176aa9385c24356858c5efbfc1aa1bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:03Z,use_quota=True,user_id='adfa9fea3ca5452da28ee863110b065f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Creating volume 6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:09:03 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:09:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:03 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 1073741824 Sep 16 16:09:03 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:04 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 1073741824" returned: 0 in 1.238s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:04 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 Sep 16 16:09:04 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:05 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3" returned: 0 in 0.755s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:09:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935f9e08-8356-4e39-bba8-b58e5c792910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a196215-7b05-4ec3-846b-aafe4eec7d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:05 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Volume volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 (6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3): created successfully Sep 16 16:09:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a196215-7b05-4ec3-846b-aafe4eec7d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Flow 'volume_create_manager' (1bcba09d-1d23-4831-a9b5-ab9f212756fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:09:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-499d7d7c-b4ef-445c-912c-6d9e206ae9c1 tempest-VolumesAdminNegativeTest-1402035166 None] Created volume successfully. Sep 16 16:09:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Acquiring lock "cinder-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:09:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Lock "cinder-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:09:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Acquiring lock "cinder-quobyte-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:09:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Lock "cinder-quobyte-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3" acquired by "delete_volume" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:09:06 devstack cinder-volume[86255]: INFO oslo.privsep.daemon [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzextwjea/privsep.sock'] Sep 16 16:09:06 devstack sudo[87605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzextwjea/privsep.sock Sep 16 16:09:06 devstack sudo[87605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:06 devstack cinder-volume[86255]: WARNING py.warnings [req-9565987f-a820-425e-a69d-77415b02728d req-6c259425-9092-413c-899d-c52e72d42a75 tempest-DeleteServersTestJSON-913252069 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 16 16:09:06 devstack cinder-volume[86255]: .first() Sep 16 16:09:06 devstack cinder-volume[86255]: Sep 16 16:09:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-9565987f-a820-425e-a69d-77415b02728d req-6c259425-9092-413c-899d-c52e72d42a75 tempest-DeleteServersTestJSON-913252069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-9565987f-a820-425e-a69d-77415b02728d req-6c259425-9092-413c-899d-c52e72d42a75 tempest-DeleteServersTestJSON-913252069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-9565987f-a820-425e-a69d-77415b02728d req-6c259425-9092-413c-899d-c52e72d42a75 tempest-DeleteServersTestJSON-913252069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-9565987f-a820-425e-a69d-77415b02728d req-6c259425-9092-413c-899d-c52e72d42a75 tempest-DeleteServersTestJSON-913252069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-5075cbbb-1305-4d94-8c83-af91cb945607', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9b661cc-a18a-4f57-a41c-46500e9e3a64', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:09:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-9565987f-a820-425e-a69d-77415b02728d req-6c259425-9092-413c-899d-c52e72d42a75 tempest-DeleteServersTestJSON-913252069 None] attachment_update completed successfully. Sep 16 16:09:08 devstack cinder-volume[86255]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 16 16:09:08 devstack cinder-volume[86255]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 16 16:09:08 devstack cinder-volume[86255]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 16 16:09:08 devstack cinder-volume[86255]: WARNING oslo.privsep.daemon [-] privsep log: Sep 16 16:09:08 devstack cinder-volume[86255]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 16 16:09:08 devstack cinder-volume[86255]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 16 16:09:08 devstack cinder-volume[86255]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 16 16:09:08 devstack cinder-volume[86255]: WARNING oslo.privsep.daemon [-] privsep log: Sep 16 16:09:08 devstack cinder-volume[86255]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Flow 'volume_create_manager' (c6ceec39-be6d-4107-9934-3a2180a2e073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db012525-5944-465d-8986-01bc2e5d6785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db012525-5944-465d-8986-01bc2e5d6785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-582664944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c6319f-baa7-4036-9668-468f2073a4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37cc8bac34b3457397036122c53fff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:08Z,use_quota=True,user_id='d918ce87200545f5b8e2ad19dc442c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1f2b28-92fc-470d-af4f-7a366bbad2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1f2b28-92fc-470d-af4f-7a366bbad2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209695bc-51b8-4d8a-a831-fc81b64a0e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209695bc-51b8-4d8a-a831-fc81b64a0e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c6319f-baa7-4036-9668-468f2073a4c0', 'volume_name': 'volume-69c6319f-baa7-4036-9668-468f2073a4c0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff353cf4-cba0-4739-9233-19fe64837aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff353cf4-cba0-4739-9233-19fe64837aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:08 devstack sudo[87605]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfbf37c-ffb3-48c9-933a-35e310ba2f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:08 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Volume 69c6319f-baa7-4036-9668-468f2073a4c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c6319f-baa7-4036-9668-468f2073a4c0', 'volume_size': 1} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-582664944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c6319f-baa7-4036-9668-468f2073a4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37cc8bac34b3457397036122c53fff2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:08Z,use_quota=True,user_id='d918ce87200545f5b8e2ad19dc442c60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Creating volume 69c6319f-baa7-4036-9668-468f2073a4c0 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:09:08 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:08 devstack cinder-volume[86255]: INFO oslo.privsep.daemon [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Spawned new privsep daemon via rootwrap Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Accepted privsep connection to /tmp/tmpzextwjea/privsep.sock {{(pid=86255) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 16 16:09:08 devstack cinder-volume[86255]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 16 16:09:08 devstack cinder-volume[86255]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 16 16:09:08 devstack cinder-volume[86255]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 16 16:09:08 devstack cinder-volume[86255]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87707 Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca8ca98-0dfe-466e-9d34-9d024280dc9e]: (2,) {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:09:08 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0 1073741824 Sep 16 16:09:08 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bc4555-ba89-40fb-9cbc-9b2f0be49453]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:09:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:09 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 Sep 16 16:09:09 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:09 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3" returned: 0 in 0.985s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:10 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3 Sep 16 16:09:10 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:10 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0 1073741824" returned: 0 in 1.493s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:10 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3" returned: 0 in 0.495s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Lock "cinder-quobyte-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3" released by "delete_volume" :: held 3.872s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:09:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:10 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0 Sep 16 16:09:10 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:10 devstack cinder-volume[86255]: WARNING cinder.quota [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:09:10 devstack cinder-volume[86255]: WARNING cinder.quota [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:09:10 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Created reservations ['656ccf4e-184d-4543-a5c5-21a97b0cf6c4', 'ac5b243d-d999-4c0f-941a-739e485daf09', 'a57640b3-780b-4c9f-829d-cf9aef854c67', 'f15c43d5-a780-4795-8f49-65fda92556cb'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:11 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:09:11 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:11 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0" returned: 0 in 0.731s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] <== create_volume: return (2509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.514s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdfbf37c-ffb3-48c9-933a-35e310ba2f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c6319f-baa7-4036-9668-468f2073a4c0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7a5a31-497f-408c-97ef-a7a010bf918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:11 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Volume volume-69c6319f-baa7-4036-9668-468f2073a4c0 (69c6319f-baa7-4036-9668-468f2073a4c0): created successfully Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7a5a31-497f-408c-97ef-a7a010bf918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Flow 'volume_create_manager' (c6ceec39-be6d-4107-9934-3a2180a2e073) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:09:11 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-eace6279-b374-4973-9ca9-363f28f6cb47 tempest-ServerRescueNegativeTestJSON-185967780 None] Created volume successfully. Sep 16 16:09:11 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.512s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:09:11 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Deleted volume successfully. Sep 16 16:09:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-462158d0-7653-41e0-982c-11ce005bdc3c tempest-VolumesAdminNegativeTest-1402035166 None] Lock "cinder-6ac968ac-52f0-4ca3-9cbb-7310ad1f22c3-delete_volume" released by "delete_volume" :: held 5.399s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:09:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-2370e511-83ab-4ec1-a8f3-02535d907def req-3c718e51-0358-46ce-9993-871ccf4b5643 tempest-DeleteServersTestJSON-913252069 None] Terminate volume connection completed successfully. Sep 16 16:09:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-2370e511-83ab-4ec1-a8f3-02535d907def req-3c718e51-0358-46ce-9993-871ccf4b5643 tempest-DeleteServersTestJSON-913252069 None] Deleting attachment a9b661cc-a18a-4f57-a41c-46500e9e3a64. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:09:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Acquiring lock "cinder-5075cbbb-1305-4d94-8c83-af91cb945607-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:09:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Lock "cinder-5075cbbb-1305-4d94-8c83-af91cb945607-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:09:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Acquiring lock "cinder-quobyte-5075cbbb-1305-4d94-8c83-af91cb945607" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:09:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Lock "cinder-quobyte-5075cbbb-1305-4d94-8c83-af91cb945607" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:09:17 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f4e937-286c-4c85-8b76-0df93cbd701c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:09:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:17 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607 Sep 16 16:09:17 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:18 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607" returned: 0 in 0.633s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:18 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607 Sep 16 16:09:18 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:18 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5075cbbb-1305-4d94-8c83-af91cb945607" returned: 0 in 0.334s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Lock "cinder-quobyte-5075cbbb-1305-4d94-8c83-af91cb945607" released by "delete_volume" :: held 1.055s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Created reservations ['28793a04-a432-41fa-ae58-281e76f19cae', '3270f989-1ddd-4c52-80ff-1460eb887dbe', 'fd845de3-1eb5-44d3-9f42-e81375a7ced6', '5713ca48-5fae-4938-866b-fa72b1449c01'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:18 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:09:18 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:18 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.375s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:18 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:09:19 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Deleted volume successfully. Sep 16 16:09:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3050d7ed-e4e2-45a2-b9ba-897c54edf28b tempest-DeleteServersTestJSON-913252069 None] Lock "cinder-5075cbbb-1305-4d94-8c83-af91cb945607-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:09:28 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=29,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:09:29 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=29,cinder:SELECT=18,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:09:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Acquiring lock "cinder-69c6319f-baa7-4036-9668-468f2073a4c0-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:09:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "cinder-69c6319f-baa7-4036-9668-468f2073a4c0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:09:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Acquiring lock "cinder-quobyte-69c6319f-baa7-4036-9668-468f2073a4c0" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:09:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "cinder-quobyte-69c6319f-baa7-4036-9668-468f2073a4c0" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:09:35 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a4ba2c-566c-4815-aa36-da732059c28e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:09:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:35 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0 Sep 16 16:09:35 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:36 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0" returned: 0 in 0.637s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:36 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0 Sep 16 16:09:36 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:36 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69c6319f-baa7-4036-9668-468f2073a4c0" returned: 0 in 0.419s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "cinder-quobyte-69c6319f-baa7-4036-9668-468f2073a4c0" released by "delete_volume" :: held 1.151s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:09:36 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Created reservations ['d6012fb1-18e3-4bdb-9488-15c7a01899c8', 'be751acb-072e-47ee-87a8-5b6ff8fce0a4', '77e759a9-27e6-4aff-b446-97f3efee62e2', 'cdb632dd-7662-477c-b3ff-655a94a2a03c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:09:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:09:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:09:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:37 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:09:37 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:37 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.396s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:37 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:09:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Deleted volume successfully. Sep 16 16:09:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cfd0c1d4-ed33-4739-8bbd-e447ff28c949 tempest-ServerRescueNegativeTestJSON-185967780 None] Lock "cinder-69c6319f-baa7-4036-9668-468f2073a4c0-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:09:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:09:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:09:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:09:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:41 devstack sudo[88349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:09:41 devstack sudo[88349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:41 devstack sudo[88349]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.304s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:41 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:09:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-676a799a-3d96-48d4-bcee-689b7489b8f9 tempest-GroupSnapshotsV319Test-202976349 None] Group tempest-GroupSnapshotsV319Test-Group-669952803: creating Sep 16 16:09:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-676a799a-3d96-48d4-bcee-689b7489b8f9 tempest-GroupSnapshotsV319Test-202976349 None] Group tempest-GroupSnapshotsV319Test-Group-669952803: created successfully Sep 16 16:09:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-676a799a-3d96-48d4-bcee-689b7489b8f9 tempest-GroupSnapshotsV319Test-202976349 None] Create group completed successfully. Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Flow 'volume_create_manager' (9335f63a-4f96-4c1c-8d61-c7265d5a4332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cbd18b-9c04-41d0-8a9d-ac16b7ecbad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cbd18b-9c04-41d0-8a9d-ac16b7ecbad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361278338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=311b4409-a658-4c9b-8f19-cd91fe8d4044,host='devstack@QuobyteHD#QuobyteHD',id=7664272e-ccb5-4f1e-9e7b-ef5f29ea096e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef0e16bd4d34781b1e30179c1dacded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:48Z,use_quota=True,user_id='655a0c36f25a4f69850e92dacb0f39f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cce86b6-9e13-4e45-819d-672066bf3d9c),volume_type_id=2cce86b6-9e13-4e45-819d-672066bf3d9c)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52bf733-5af0-4ea3-9dd4-e603277ce5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52bf733-5af0-4ea3-9dd4-e603277ce5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ef154f-2aee-4dbe-8ae4-7f25db5a0295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ef154f-2aee-4dbe-8ae4-7f25db5a0295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7664272e-ccb5-4f1e-9e7b-ef5f29ea096e', 'volume_name': 'volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3f4191-ef9a-4b07-8e89-8530aca7f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3f4191-ef9a-4b07-8e89-8530aca7f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83103938-2298-4b58-b2ae-1dd552a78570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:48 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Volume 7664272e-ccb5-4f1e-9e7b-ef5f29ea096e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e', 'volume_size': 1} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=311b4409-a658-4c9b-8f19-cd91fe8d4044,created_at=2026-09-16T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-361278338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=311b4409-a658-4c9b-8f19-cd91fe8d4044,host='devstack@QuobyteHD#QuobyteHD',id=7664272e-ccb5-4f1e-9e7b-ef5f29ea096e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef0e16bd4d34781b1e30179c1dacded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:09:48Z,use_quota=True,user_id='655a0c36f25a4f69850e92dacb0f39f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cce86b6-9e13-4e45-819d-672066bf3d9c),volume_type_id=2cce86b6-9e13-4e45-819d-672066bf3d9c)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Creating volume 7664272e-ccb5-4f1e-9e7b-ef5f29ea096e {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:09:48 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:09:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:48 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e 1073741824 Sep 16 16:09:48 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:49 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e 1073741824" returned: 0 in 0.652s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:49 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e Sep 16 16:09:49 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:49 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" returned: 0 in 0.279s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:09:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83103938-2298-4b58-b2ae-1dd552a78570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bee7573-6d78-4b22-bf89-e2fe7350ccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:09:49 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Volume volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e (7664272e-ccb5-4f1e-9e7b-ef5f29ea096e): created successfully Sep 16 16:09:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bee7573-6d78-4b22-bf89-e2fe7350ccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:09:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Flow 'volume_create_manager' (9335f63a-4f96-4c1c-8d61-c7265d5a4332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:09:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e1b3b699-7884-4008-b0e0-39662c9f0b89 tempest-GroupSnapshotsV319Test-202976349 None] Created volume successfully. Sep 16 16:09:51 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] GroupSnapshot 45beb559-516c-48e5-8032-f441e570e357: creating. Sep 16 16:09:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Group snapshot 45beb559-516c-48e5-8032-f441e570e357: creating. {{(pid=86255) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 16 16:09:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:09:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:09:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Creating offline snapshot 645daa73-ca8d-4b05-923f-7a906dfed7c4 of volume 7664272e-ccb5-4f1e-9e7b-ef5f29ea096e {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:09:51 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4923c-04c1-447b-8e00-3d694af74d28]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:09:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:51 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e Sep 16 16:09:51 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:51 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" returned: 0 in 0.511s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:51 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 1G Sep 16 16:09:51 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:52 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 1G" returned: 0 in 0.490s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:52 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 Sep 16 16:09:52 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:52 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4" returned: 0 in 0.322s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:52 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:09:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:52 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 Sep 16 16:09:52 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:53 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4" returned: 0 in 0.322s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:53 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.info Sep 16 16:09:53 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:53 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.info" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:53 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:09:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:53 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.info Sep 16 16:09:53 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:53 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.info" returned: 0 in 0.272s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:09:53 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6c4e6e95-3f4d-4c42-ad1c-87ba4d71a70d tempest-GroupSnapshotsV319Test-202976349 None] group_snapshot 45beb559-516c-48e5-8032-f441e570e357: created successfully Sep 16 16:09:55 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] group_snapshot 45beb559-516c-48e5-8032-f441e570e357: deleting Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] group_snapshot 45beb559-516c-48e5-8032-f441e570e357: deleting {{(pid=86255) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Acquiring lock "cinder-quobyte-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Lock "cinder-quobyte-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Acquiring lock "cinder-quobyte-645daa73-ca8d-4b05-923f-7a906dfed7c4" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Lock "cinder-quobyte-645daa73-ca8d-4b05-923f-7a906dfed7c4" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Deleting offline snapshot 645daa73-ca8d-4b05-923f-7a906dfed7c4 of volume 7664272e-ccb5-4f1e-9e7b-ef5f29ea096e {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] snapshot_file for this snap is: volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e0b63f-4477-4b08-8681-b82b14dfd00b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:55 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 Sep 16 16:09:55 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:55 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4" returned: 0 in 0.478s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9843b8f8-96c9-482c-a995-e1b82f0bb125]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:09:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:56 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e Sep 16 16:09:56 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:56 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" returned: 0 in 0.384s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:56 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 Sep 16 16:09:56 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:56 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4" returned: 0 in 0.463s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:56 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4 Sep 16 16:09:56 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:57 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e.645daa73-ca8d-4b05-923f-7a906dfed7c4" returned: 0 in 0.318s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Lock "cinder-quobyte-645daa73-ca8d-4b05-923f-7a906dfed7c4" released by "_delete_snapshot" :: held 1.852s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:09:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Lock "cinder-quobyte-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" released by "delete_snapshot" :: held 1.897s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:09:57 devstack cinder-volume[86255]: WARNING cinder.quota [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1701981751 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1701981751, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:09:57 devstack cinder-volume[86255]: WARNING cinder.quota [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1701981751 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1701981751, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:09:57 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] Created reservations ['2adfe491-ebd0-410f-b3a5-a2a7184f0f6a', '72175df9-42d6-4bae-be97-359211e03934', '3b43a3b9-e908-4de3-a2f7-bb5480485e76', '6300d2f3-f43a-433e-ae5b-0c7891589d5a'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:09:57 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ede6ec1b-a514-4c89-9326-d2ce0e2e7c0e tempest-GroupSnapshotsV319Test-202976349 None] group_snapshot 45beb559-516c-48e5-8032-f441e570e357: deleted successfully Sep 16 16:09:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Acquiring lock "cinder-quobyte-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:09:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Lock "cinder-quobyte-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:09:58 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0dc416-8cbb-47ab-bc0f-6d2e7d565ace]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:09:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:58 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e Sep 16 16:09:58 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:09:59 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Sep 16 16:09:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" returned: 0 in 0.639s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:09:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:09:59 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e Sep 16 16:09:59 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:00 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" returned: 0 in 0.736s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Lock "cinder-quobyte-7664272e-ccb5-4f1e-9e7b-ef5f29ea096e" released by "delete_volume" :: held 1.508s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Created reservations ['ffbf81dd-61ec-4dc5-a200-7a42b91beb2d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:00 devstack cinder-volume[86255]: WARNING cinder.quota [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1701981751 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1701981751, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Created reservations ['887e0c10-790a-4161-8b2a-60f7c744a9c7', 'bbe77918-db82-4c66-a23f-e286a336ea95', 'bcbfb6e8-1f1f-4575-b0e2-8dccb7b59086', '9ef822b5-602c-44fb-b584-d45b5b704c3b'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:00 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:10:00 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:01 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.503s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:01 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:10:01 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-043e5bfd-6ebb-4ca0-b829-1df80409db2b tempest-GroupSnapshotsV319Test-202976349 None] Delete group completed successfully. Sep 16 16:10:10 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=29,cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:10:10 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=31,cinder:INSERT=9,cinder:UPDATE=32 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:10:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c5e981c7-45f0-453d-9cc5-5b1ac9eec73e tempest-GroupsTest-322853947 None] Group tempest-Group1-1593378770: creating Sep 16 16:10:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c5e981c7-45f0-453d-9cc5-5b1ac9eec73e tempest-GroupsTest-322853947 None] Group tempest-Group1-1593378770: created successfully Sep 16 16:10:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c5e981c7-45f0-453d-9cc5-5b1ac9eec73e tempest-GroupsTest-322853947 None] Create group completed successfully. Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Flow 'volume_create_manager' (f3f29847-1260-439d-ae68-e4902a389b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdfb211-1d0e-47a0-89ee-1d360ec5b11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdfb211-1d0e-47a0-89ee-1d360ec5b11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-609836600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0e47a4-1155-4155-b15d-a6914a5407df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98b09afb3be449e8c73af49cb4f4602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:30Z,use_quota=True,user_id='95998ac69ccb4f0084827c33fdcd05a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c35023c-11d0-4922-9dec-6ccd5fc3de57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c35023c-11d0-4922-9dec-6ccd5fc3de57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcd5b42-d6eb-4d51-9c3b-72aeaa8035b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcd5b42-d6eb-4d51-9c3b-72aeaa8035b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0e47a4-1155-4155-b15d-a6914a5407df', 'volume_name': 'volume-3e0e47a4-1155-4155-b15d-a6914a5407df', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37876004-0677-4222-b343-089bc597937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37876004-0677-4222-b343-089bc597937f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b57d0f8-adea-475b-8bb3-ad8799839f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:30 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Volume 3e0e47a4-1155-4155-b15d-a6914a5407df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0e47a4-1155-4155-b15d-a6914a5407df', 'volume_size': 1} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-609836600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0e47a4-1155-4155-b15d-a6914a5407df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98b09afb3be449e8c73af49cb4f4602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:30Z,use_quota=True,user_id='95998ac69ccb4f0084827c33fdcd05a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Creating volume 3e0e47a4-1155-4155-b15d-a6914a5407df {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:10:30 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:30 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df 1073741824 Sep 16 16:10:30 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:30 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-bce97598-751d-43ea-a025-571ec60598e3 tempest-GroupsTest-322853947 None] Group tempest-Group2-328425506: creating Sep 16 16:10:30 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-bce97598-751d-43ea-a025-571ec60598e3 tempest-GroupsTest-322853947 None] Group tempest-Group2-328425506: created successfully Sep 16 16:10:30 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-bce97598-751d-43ea-a025-571ec60598e3 tempest-GroupsTest-322853947 None] Create group completed successfully. Sep 16 16:10:30 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df 1073741824" returned: 0 in 0.883s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:31 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df Sep 16 16:10:31 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:31 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df" returned: 0 in 0.441s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:10:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b57d0f8-adea-475b-8bb3-ad8799839f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0e47a4-1155-4155-b15d-a6914a5407df', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28d13f7-0a56-40fe-866f-1ce0653d53e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:31 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Volume volume-3e0e47a4-1155-4155-b15d-a6914a5407df (3e0e47a4-1155-4155-b15d-a6914a5407df): created successfully Sep 16 16:10:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28d13f7-0a56-40fe-866f-1ce0653d53e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Flow 'volume_create_manager' (f3f29847-1260-439d-ae68-e4902a389b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7ef481b1-a9e1-403e-8ab3-55d291294cf1 tempest-TaggedAttachmentsTest-1853448199 None] Created volume successfully. Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Flow 'volume_create_manager' (66b3967f-ccde-4265-add2-ddd657d516b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77b1cb3-e102-4b24-8d21-bc17dcd87550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77b1cb3-e102-4b24-8d21-bc17dcd87550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1477232058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53347e9d-b7c5-489e-a4a8-cfbb89a928ca,host='devstack@QuobyteHD#QuobyteHD',id=09fe1828-5385-4547-8f86-e3f31718dfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6467843ef44793bdc5734d0f054881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:32Z,use_quota=True,user_id='56731ca5871b4b5db2b7192b57eb5677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abef25f5-a97d-4a79-b4d4-5aaecec69de3),volume_type_id=abef25f5-a97d-4a79-b4d4-5aaecec69de3)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3161f107-2c4c-4085-9ac1-b78d240a03cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3161f107-2c4c-4085-9ac1-b78d240a03cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454a64c2-e3b6-4961-a66b-47ab4ef41916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454a64c2-e3b6-4961-a66b-47ab4ef41916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fe1828-5385-4547-8f86-e3f31718dfc6', 'volume_name': 'volume-09fe1828-5385-4547-8f86-e3f31718dfc6', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8355dc-8df9-41aa-9945-92ca3c28b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8355dc-8df9-41aa-9945-92ca3c28b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c243d2b1-41b4-4756-b067-be5910ccfe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:32 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Volume 09fe1828-5385-4547-8f86-e3f31718dfc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fe1828-5385-4547-8f86-e3f31718dfc6', 'volume_size': 1} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53347e9d-b7c5-489e-a4a8-cfbb89a928ca,created_at=2026-09-16T14:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1477232058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53347e9d-b7c5-489e-a4a8-cfbb89a928ca,host='devstack@QuobyteHD#QuobyteHD',id=09fe1828-5385-4547-8f86-e3f31718dfc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6467843ef44793bdc5734d0f054881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:32Z,use_quota=True,user_id='56731ca5871b4b5db2b7192b57eb5677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abef25f5-a97d-4a79-b4d4-5aaecec69de3),volume_type_id=abef25f5-a97d-4a79-b4d4-5aaecec69de3)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Creating volume 09fe1828-5385-4547-8f86-e3f31718dfc6 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:10:32 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:10:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:32 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6 1073741824 Sep 16 16:10:32 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:33 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6 1073741824" returned: 0 in 0.661s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:33 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6 Sep 16 16:10:33 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:33 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6" returned: 0 in 0.406s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:10:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c243d2b1-41b4-4756-b067-be5910ccfe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fe1828-5385-4547-8f86-e3f31718dfc6', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d3e6ae-ef37-4564-840d-82226fdbfc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Volume volume-09fe1828-5385-4547-8f86-e3f31718dfc6 (09fe1828-5385-4547-8f86-e3f31718dfc6): created successfully Sep 16 16:10:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d3e6ae-ef37-4564-840d-82226fdbfc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Flow 'volume_create_manager' (66b3967f-ccde-4265-add2-ddd657d516b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:33 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-be5d75b2-accf-4237-be6b-dbd53a4a33cb tempest-GroupsTest-322853947 None] Created volume successfully. Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Flow 'volume_create_manager' (66f552d6-562f-4844-9dc1-d6f0c8bfbb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f8b423-b2fb-4aac-8f32-2f2bbe86d955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f8b423-b2fb-4aac-8f32-2f2bbe86d955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-361604781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566cf3d2-ea68-48af-8712-27c58bec67b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ffa69ecb04422ca4363b9277d76849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:34Z,use_quota=True,user_id='02e75ba8573d44dfb335420bf2c2017f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5fd18a-707f-4ad0-a616-bd77525aa197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5fd18a-707f-4ad0-a616-bd77525aa197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62d5ea7-9846-44d1-8d73-4551a45d1e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62d5ea7-9846-44d1-8d73-4551a45d1e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566cf3d2-ea68-48af-8712-27c58bec67b4', 'volume_name': 'volume-566cf3d2-ea68-48af-8712-27c58bec67b4', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe07cec-e111-430d-9e69-b60a6b32a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe07cec-e111-430d-9e69-b60a6b32a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd7ff25-9f4c-44f8-b76c-c6fd669d2958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Volume 566cf3d2-ea68-48af-8712-27c58bec67b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566cf3d2-ea68-48af-8712-27c58bec67b4', 'volume_size': 1} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-361604781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566cf3d2-ea68-48af-8712-27c58bec67b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ffa69ecb04422ca4363b9277d76849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:34Z,use_quota=True,user_id='02e75ba8573d44dfb335420bf2c2017f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Creating volume 566cf3d2-ea68-48af-8712-27c58bec67b4 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:10:34 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:10:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:34 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4 1073741824 Sep 16 16:10:34 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:35 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4 1073741824" returned: 0 in 1.018s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:35 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4 Sep 16 16:10:35 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Acquiring lock "cinder-quobyte-09fe1828-5385-4547-8f86-e3f31718dfc6" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Lock "cinder-quobyte-09fe1828-5385-4547-8f86-e3f31718dfc6" acquired by "delete_volume" :: waited 0.035s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:10:36 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4" returned: 0 in 0.639s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f54796-62c5-44b1-b1a1-d3634bd046e2]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd7ff25-9f4c-44f8-b76c-c6fd669d2958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566cf3d2-ea68-48af-8712-27c58bec67b4', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e699f581-6fa5-4b76-b9fb-9a990b030f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:36 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Volume volume-566cf3d2-ea68-48af-8712-27c58bec67b4 (566cf3d2-ea68-48af-8712-27c58bec67b4): created successfully Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e699f581-6fa5-4b76-b9fb-9a990b030f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Flow 'volume_create_manager' (66f552d6-562f-4844-9dc1-d6f0c8bfbb2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a3d8b87b-7a57-485d-9178-c87da7ac9b1f tempest-ServersNegativeTestJSON-2047927021 None] Created volume successfully. Sep 16 16:10:36 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6 Sep 16 16:10:36 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:37 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6" returned: 0 in 0.875s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:37 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6 Sep 16 16:10:37 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:37 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-09fe1828-5385-4547-8f86-e3f31718dfc6" returned: 0 in 0.445s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Lock "cinder-quobyte-09fe1828-5385-4547-8f86-e3f31718dfc6" released by "delete_volume" :: held 1.438s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:10:37 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Created reservations ['3ac5650d-aa82-4a41-8a72-c30dd8b2b4a2'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:38 devstack cinder-volume[86255]: WARNING cinder.quota [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1852395611 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1852395611, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:10:38 devstack cinder-volume[86255]: WARNING cinder.quota [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1852395611 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1852395611, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:10:38 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Created reservations ['2b44e814-2771-4b81-99cf-4ed7626ffc24', 'a95f2295-9c1d-4bea-9433-aa90e4f0ac54', '7ed1ecab-203f-46da-8f99-54d3445535a4', '259aaaf8-8de9-41ef-869c-410c95ae67ba'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:38 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:10:38 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:38 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.512s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:38 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:10:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0bfdc72b-8df6-4bf2-ab58-06210c715d8e tempest-GroupsTest-322853947 None] Delete group completed successfully. Sep 16 16:10:39 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] Created reservations ['2e723593-709d-43a5-baf9-f87437292646'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:39 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:10:39 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:40 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.377s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:10:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-43e015b5-b61c-41db-ac76-ce608a382cd9 tempest-GroupsTest-322853947 None] Delete group completed successfully. Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Flow 'volume_create_manager' (32331e30-8d7b-41a5-bd03-4308a5a91ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b639b3-a664-4cbb-9b8a-6e6c8cd41917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b639b3-a664-4cbb-9b8a-6e6c8cd41917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1445172771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5118e119-e0a1-4d67-8ad7-dccc1caa5579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ffa69ecb04422ca4363b9277d76849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:41Z,use_quota=True,user_id='02e75ba8573d44dfb335420bf2c2017f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc201be3-6d5e-4ca9-9440-5336f0e2d7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc201be3-6d5e-4ca9-9440-5336f0e2d7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190782e6-456b-4b3b-9706-68d7aa50ed87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190782e6-456b-4b3b-9706-68d7aa50ed87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5118e119-e0a1-4d67-8ad7-dccc1caa5579', 'volume_name': 'volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143f505e-9226-4ba0-ac99-a5bd8e1db81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143f505e-9226-4ba0-ac99-a5bd8e1db81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba6e10e-0c6d-4a76-bccf-bedc64151a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:40 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Volume 5118e119-e0a1-4d67-8ad7-dccc1caa5579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579', 'volume_size': 1} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1445172771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5118e119-e0a1-4d67-8ad7-dccc1caa5579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ffa69ecb04422ca4363b9277d76849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:41Z,use_quota=True,user_id='02e75ba8573d44dfb335420bf2c2017f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Creating volume 5118e119-e0a1-4d67-8ad7-dccc1caa5579 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:10:40 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:10:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:40 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 1073741824 Sep 16 16:10:40 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:10:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:41 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:10:41 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:41 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 1073741824" returned: 0 in 0.877s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:41 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-edbc29ec-2d87-4e19-a93e-9860930be8c2 tempest-GroupsTest-322853947 None] Group tempest-GroupsTest-Group-680852855: creating Sep 16 16:10:41 devstack sudo[88900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 Sep 16 16:10:41 devstack sudo[88900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:41 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-edbc29ec-2d87-4e19-a93e-9860930be8c2 tempest-GroupsTest-322853947 None] Group tempest-GroupsTest-Group-680852855: created successfully Sep 16 16:10:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-edbc29ec-2d87-4e19-a93e-9860930be8c2 tempest-GroupsTest-322853947 None] Create group completed successfully. Sep 16 16:10:42 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.455s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 8 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:10:42 devstack sudo[88900]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579" returned: 0 in 0.479s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba6e10e-0c6d-4a76-bccf-bedc64151a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b49194f-a67d-4ec7-ba98-60b6d3c02f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:42 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Volume volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 (5118e119-e0a1-4d67-8ad7-dccc1caa5579): created successfully Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b49194f-a67d-4ec7-ba98-60b6d3c02f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Flow 'volume_create_manager' (32331e30-8d7b-41a5-bd03-4308a5a91ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3f323b62-7f17-45ea-b3a7-1b6999039805 tempest-ServersNegativeTestJSON-2047927021 None] Created volume successfully. Sep 16 16:10:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "cinder-5118e119-e0a1-4d67-8ad7-dccc1caa5579-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:10:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Lock "cinder-5118e119-e0a1-4d67-8ad7-dccc1caa5579-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:10:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "cinder-quobyte-5118e119-e0a1-4d67-8ad7-dccc1caa5579" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Lock "cinder-quobyte-5118e119-e0a1-4d67-8ad7-dccc1caa5579" acquired by "delete_volume" :: waited 0.035s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Flow 'volume_create_manager' (29b47ccf-8276-4bba-b7d6-cc4571845424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2de61a2-da45-48dd-bedf-dcb45ff53c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4e866d-4a37-4c32-96da-94fd1a0c6290]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2de61a2-da45-48dd-bedf-dcb45ff53c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1326938002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=255dc6fe-577e-4c64-aac1-3a8c410d82dd,host='devstack@QuobyteHD#QuobyteHD',id=c0ec6db1-091a-41c7-a633-addfa9734d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6467843ef44793bdc5734d0f054881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:44Z,use_quota=True,user_id='56731ca5871b4b5db2b7192b57eb5677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2427ff5b-7e30-4d4d-9dda-a3a9f95444d1),volume_type_id=2427ff5b-7e30-4d4d-9dda-a3a9f95444d1)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464a3f58-b15c-473d-8650-81f613bd1387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464a3f58-b15c-473d-8650-81f613bd1387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba947af-ab8a-4349-80d1-a9b922f84bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba947af-ab8a-4349-80d1-a9b922f84bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ec6db1-091a-41c7-a633-addfa9734d4c', 'volume_name': 'volume-c0ec6db1-091a-41c7-a633-addfa9734d4c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49df2b2-536c-484d-bbf9-af7a983c7a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49df2b2-536c-484d-bbf9-af7a983c7a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95a35b5-ccb5-4667-83bc-eff9c516d00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:44 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Volume c0ec6db1-091a-41c7-a633-addfa9734d4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ec6db1-091a-41c7-a633-addfa9734d4c', 'volume_size': 1} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=255dc6fe-577e-4c64-aac1-3a8c410d82dd,created_at=2026-09-16T14:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1326938002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=255dc6fe-577e-4c64-aac1-3a8c410d82dd,host='devstack@QuobyteHD#QuobyteHD',id=c0ec6db1-091a-41c7-a633-addfa9734d4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6467843ef44793bdc5734d0f054881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:44Z,use_quota=True,user_id='56731ca5871b4b5db2b7192b57eb5677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2427ff5b-7e30-4d4d-9dda-a3a9f95444d1),volume_type_id=2427ff5b-7e30-4d4d-9dda-a3a9f95444d1)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Creating volume c0ec6db1-091a-41c7-a633-addfa9734d4c {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:10:44 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:44 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c 1073741824 Sep 16 16:10:44 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:44 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 Sep 16 16:10:44 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:44 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579" returned: 0 in 0.498s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:44 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579 Sep 16 16:10:44 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:44 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c 1073741824" returned: 0 in 0.608s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:44 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c Sep 16 16:10:44 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:44 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5118e119-e0a1-4d67-8ad7-dccc1caa5579" returned: 0 in 0.324s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Lock "cinder-quobyte-5118e119-e0a1-4d67-8ad7-dccc1caa5579" released by "delete_volume" :: held 0.927s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Created reservations ['06b5d8a5-ea16-4d13-a757-7f90e9ee9cb8', '14a10b17-5248-419a-a92f-48efe0c4fe8c', 'd08e1bc1-2979-4431-94b4-7c37bceda9a8', '4a5fea8a-c045-4b0e-92ec-d2897e5bc87c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:45 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:10:45 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:45 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c" returned: 0 in 0.517s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95a35b5-ccb5-4667-83bc-eff9c516d00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ec6db1-091a-41c7-a633-addfa9734d4c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc3d28c-4be6-422d-b33c-d8a44a1164d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:45 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Volume volume-c0ec6db1-091a-41c7-a633-addfa9734d4c (c0ec6db1-091a-41c7-a633-addfa9734d4c): created successfully Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc3d28c-4be6-422d-b33c-d8a44a1164d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Flow 'volume_create_manager' (29b47ccf-8276-4bba-b7d6-cc4571845424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8fc9e147-54d5-4b97-a649-b6c0149fd2cb tempest-GroupsTest-322853947 None] Created volume successfully. Sep 16 16:10:45 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.599s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:10:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Deleted volume successfully. Sep 16 16:10:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d165a240-23c1-4bcd-a2ed-58ae6df4b62f tempest-ServersNegativeTestJSON-2047927021 None] Lock "cinder-5118e119-e0a1-4d67-8ad7-dccc1caa5579-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:10:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "cinder-566cf3d2-ea68-48af-8712-27c58bec67b4-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:10:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Lock "cinder-566cf3d2-ea68-48af-8712-27c58bec67b4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:10:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "cinder-quobyte-566cf3d2-ea68-48af-8712-27c58bec67b4" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:10:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Lock "cinder-quobyte-566cf3d2-ea68-48af-8712-27c58bec67b4" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:10:46 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6397fa9b-0b4b-4a31-b8f6-96b5e6b6bee6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:10:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:46 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4 Sep 16 16:10:46 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:47 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4" returned: 0 in 0.902s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:47 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4 Sep 16 16:10:47 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:10:48 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Flow 'volume_create_manager' (ebda30af-0c95-41b6-bf7d-96b382b9cf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d80d6c-7f53-4598-8bcf-822e9fc6983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-566cf3d2-ea68-48af-8712-27c58bec67b4" returned: 0 in 0.884s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d80d6c-7f53-4598-8bcf-822e9fc6983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1782404620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=255dc6fe-577e-4c64-aac1-3a8c410d82dd,host='devstack@QuobyteHD#QuobyteHD',id=95db00aa-1445-4d2b-a148-35adbb8003a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6467843ef44793bdc5734d0f054881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:48Z,use_quota=True,user_id='56731ca5871b4b5db2b7192b57eb5677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2427ff5b-7e30-4d4d-9dda-a3a9f95444d1),volume_type_id=2427ff5b-7e30-4d4d-9dda-a3a9f95444d1)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed18f8ac-950f-4735-af0a-c3fc5859abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed18f8ac-950f-4735-af0a-c3fc5859abb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0418c3-1bf8-4b76-bc51-039fb37894c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0418c3-1bf8-4b76-bc51-039fb37894c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95db00aa-1445-4d2b-a148-35adbb8003a5', 'volume_name': 'volume-95db00aa-1445-4d2b-a148-35adbb8003a5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db9829b-d356-4d0a-89bd-99f1fd3f527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db9829b-d356-4d0a-89bd-99f1fd3f527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc680420-c588-46ef-b58b-effd5d49ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:48 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Volume 95db00aa-1445-4d2b-a148-35adbb8003a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95db00aa-1445-4d2b-a148-35adbb8003a5', 'volume_size': 1} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=255dc6fe-577e-4c64-aac1-3a8c410d82dd,created_at=2026-09-16T14:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1782404620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=255dc6fe-577e-4c64-aac1-3a8c410d82dd,host='devstack@QuobyteHD#QuobyteHD',id=95db00aa-1445-4d2b-a148-35adbb8003a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6467843ef44793bdc5734d0f054881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:10:48Z,use_quota=True,user_id='56731ca5871b4b5db2b7192b57eb5677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2427ff5b-7e30-4d4d-9dda-a3a9f95444d1),volume_type_id=2427ff5b-7e30-4d4d-9dda-a3a9f95444d1)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Creating volume 95db00aa-1445-4d2b-a148-35adbb8003a5 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:10:48 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Lock "cinder-quobyte-566cf3d2-ea68-48af-8712-27c58bec67b4" released by "delete_volume" :: held 2.074s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:10:48 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5 1073741824 Sep 16 16:10:48 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Created reservations ['a1165a20-e34c-48c9-9f13-1521d8bb3246', '739ac4df-6ee6-4855-b40d-d4beea4b9be7', '463612f9-f4ad-446a-a18c-16b64fddcf9f', '51db6c50-0958-4d99-b7bb-e4c539bd3a17'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:48 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:10:48 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:49 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.323s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:10:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Deleted volume successfully. Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4240f205-3c8e-41c7-b018-4705517c411a tempest-ServersNegativeTestJSON-2047927021 None] Lock "cinder-566cf3d2-ea68-48af-8712-27c58bec67b4-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:10:49 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5 1073741824" returned: 0 in 0.758s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:49 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5 Sep 16 16:10:49 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:49 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5" returned: 0 in 0.525s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc680420-c588-46ef-b58b-effd5d49ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95db00aa-1445-4d2b-a148-35adbb8003a5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65dc34b-9c2c-4757-962b-e1ccddcf4af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:10:49 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Volume volume-95db00aa-1445-4d2b-a148-35adbb8003a5 (95db00aa-1445-4d2b-a148-35adbb8003a5): created successfully Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65dc34b-9c2c-4757-962b-e1ccddcf4af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:10:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Flow 'volume_create_manager' (ebda30af-0c95-41b6-bf7d-96b382b9cf00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:10:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e7c21b67-67a7-4c1c-87d6-404f8e7b5a1d tempest-GroupsTest-322853947 None] Created volume successfully. Sep 16 16:10:51 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-272a1ca2-beff-49a7-8e65-6504d4494d5f tempest-GroupsTest-322853947 None] Update group completed successfully. Sep 16 16:10:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-250eec57-f3df-4aac-8b38-4d81781fcbe5 tempest-GroupsTest-322853947 None] Update group completed successfully. Sep 16 16:10:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Acquiring lock "cinder-quobyte-95db00aa-1445-4d2b-a148-35adbb8003a5" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:10:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Lock "cinder-quobyte-95db00aa-1445-4d2b-a148-35adbb8003a5" acquired by "delete_volume" :: waited 0.058s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:10:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[21052978-3707-4ea1-acd8-91fec9164b58]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:10:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:54 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5 Sep 16 16:10:54 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:55 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5" returned: 0 in 0.396s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:55 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5 Sep 16 16:10:55 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:55 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-95db00aa-1445-4d2b-a148-35adbb8003a5" returned: 0 in 0.239s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Lock "cinder-quobyte-95db00aa-1445-4d2b-a148-35adbb8003a5" released by "delete_volume" :: held 0.721s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Acquiring lock "cinder-quobyte-c0ec6db1-091a-41c7-a633-addfa9734d4c" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Lock "cinder-quobyte-c0ec6db1-091a-41c7-a633-addfa9734d4c" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e90c6d-9dda-4a7e-bebb-b42d399bd4b0]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:55 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c Sep 16 16:10:55 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:55 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c" returned: 0 in 0.440s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:55 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c Sep 16 16:10:55 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:56 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c0ec6db1-091a-41c7-a633-addfa9734d4c" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Lock "cinder-quobyte-c0ec6db1-091a-41c7-a633-addfa9734d4c" released by "delete_volume" :: held 0.757s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Created reservations ['fefa33ce-8b45-4162-b3bc-60735f92a97f'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:56 devstack cinder-volume[86255]: WARNING cinder.quota [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1715793908 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1715793908, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:10:56 devstack cinder-volume[86255]: WARNING cinder.quota [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1715793908 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1715793908, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Created reservations ['33c66144-2367-49a1-9739-2de7cdd7a83b', 'b76c36a4-9fca-4010-864c-f3163d3ab695', '8bba48f1-5333-4bac-8c11-ef592c2042a7', 'daffa668-d23c-46f5-85c2-fbe77f588578'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Created reservations ['b395da6e-ec38-4ea6-9d5e-f60bcf7e2691', 'f547a22f-f41f-4d99-8870-e7ecf84a5621', 'ac633035-297c-47cb-be1e-adc20bbebcae', '911e80aa-6dac-4e2b-99ca-fc0ec8424d7d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:10:56 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:10:56 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:10:56 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.261s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:10:56 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:10:56 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4e61d584-e352-4ab8-a88c-eec9a320126b tempest-GroupsTest-322853947 None] Delete group completed successfully. Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Flow 'volume_create_manager' (b4abb9bb-8bfa-4e24-9c34-699bdf6af321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf820379-ac67-4078-989f-26067896cf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf820379-ac67-4078-989f-26067896cf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1892329898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553a59c7-e63f-43c9-b362-68be89dcc36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3122a85bf0b409d94e1dd4fa2c7b3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:01Z,use_quota=True,user_id='4c36f6c382af40c5a813c8d69dd94a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51137fa3-b43d-4675-994c-06aefaeda77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51137fa3-b43d-4675-994c-06aefaeda77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4a2e30-3291-486e-a5c3-2a5db4323dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4a2e30-3291-486e-a5c3-2a5db4323dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553a59c7-e63f-43c9-b362-68be89dcc36e', 'volume_name': 'volume-553a59c7-e63f-43c9-b362-68be89dcc36e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c0a703-49e7-423f-acef-d8c5321b2fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4c0a703-49e7-423f-acef-d8c5321b2fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8efe37-e160-4e1e-bf0b-d94d5427347f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:01 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Volume 553a59c7-e63f-43c9-b362-68be89dcc36e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553a59c7-e63f-43c9-b362-68be89dcc36e', 'volume_size': 1} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1892329898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553a59c7-e63f-43c9-b362-68be89dcc36e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3122a85bf0b409d94e1dd4fa2c7b3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:01Z,use_quota=True,user_id='4c36f6c382af40c5a813c8d69dd94a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Creating volume 553a59c7-e63f-43c9-b362-68be89dcc36e {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:11:01 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:11:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:01 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e 1073741824 Sep 16 16:11:01 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:02 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e 1073741824" returned: 0 in 0.692s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:02 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e Sep 16 16:11:02 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:02 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e" returned: 0 in 0.420s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:02 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:11:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8efe37-e160-4e1e-bf0b-d94d5427347f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553a59c7-e63f-43c9-b362-68be89dcc36e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd95f6d9-544c-4a8a-b5bb-2b6032cf49ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:02 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Volume volume-553a59c7-e63f-43c9-b362-68be89dcc36e (553a59c7-e63f-43c9-b362-68be89dcc36e): created successfully Sep 16 16:11:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd95f6d9-544c-4a8a-b5bb-2b6032cf49ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Flow 'volume_create_manager' (b4abb9bb-8bfa-4e24-9c34-699bdf6af321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:11:02 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0c928bf0-4277-4c0c-8696-9410f2d6a8ec tempest-AttachVolumeNegativeTest-1290048330 None] Created volume successfully. Sep 16 16:11:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-f89b3382-9a4e-44a8-99ce-00334430a761 req-674b1538-1371-4aaf-93b9-f25812bd6c7b tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-f89b3382-9a4e-44a8-99ce-00334430a761 req-674b1538-1371-4aaf-93b9-f25812bd6c7b tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-f89b3382-9a4e-44a8-99ce-00334430a761 req-674b1538-1371-4aaf-93b9-f25812bd6c7b tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-f89b3382-9a4e-44a8-99ce-00334430a761 req-674b1538-1371-4aaf-93b9-f25812bd6c7b tempest-AttachVolumeNegativeTest-1290048330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-553a59c7-e63f-43c9-b362-68be89dcc36e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6de2abc6-c027-4542-8604-15676c0f217f', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:11:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-f89b3382-9a4e-44a8-99ce-00334430a761 req-674b1538-1371-4aaf-93b9-f25812bd6c7b tempest-AttachVolumeNegativeTest-1290048330 None] attachment_update completed successfully. Sep 16 16:11:15 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=66,cinder:UPDATE=71,cinder:DELETE=4,cinder:INSERT=14 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:11:15 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=65,cinder:UPDATE=79,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Flow 'volume_create_manager' (4a7968ff-d188-47ad-b2b0-5cb5e866dddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5a0311-f2e5-4758-a0d8-0c3de05d0d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5a0311-f2e5-4758-a0d8-0c3de05d0d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-359266808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72804051-6456-4c61-a518-4ddb1ce6d4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d1072690a2414a9675d1c7bfc75cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:21Z,use_quota=True,user_id='adb16c558a434f369bb8a0e042727d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c162b56c-273c-4898-9b8d-60b6dd657ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c162b56c-273c-4898-9b8d-60b6dd657ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1961c67-15d8-498c-8bab-e99239ac635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1961c67-15d8-498c-8bab-e99239ac635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72804051-6456-4c61-a518-4ddb1ce6d4b3', 'volume_name': 'volume-72804051-6456-4c61-a518-4ddb1ce6d4b3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f10dcf1-3172-4c13-8e36-e0c453fe2649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f10dcf1-3172-4c13-8e36-e0c453fe2649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15b10c3-8e33-4efc-ba68-7e545d81a2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:21 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Volume 72804051-6456-4c61-a518-4ddb1ce6d4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72804051-6456-4c61-a518-4ddb1ce6d4b3', 'volume_size': 1} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-359266808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72804051-6456-4c61-a518-4ddb1ce6d4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d1072690a2414a9675d1c7bfc75cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:21Z,use_quota=True,user_id='adb16c558a434f369bb8a0e042727d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Creating volume 72804051-6456-4c61-a518-4ddb1ce6d4b3 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:11:21 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:11:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:21 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 1073741824 Sep 16 16:11:21 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:22 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 1073741824" returned: 0 in 0.981s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:22 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 Sep 16 16:11:22 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:23 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3" returned: 0 in 0.538s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:11:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15b10c3-8e33-4efc-ba68-7e545d81a2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72804051-6456-4c61-a518-4ddb1ce6d4b3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e55b12f-8a11-4a0d-ae5b-d6a64df52dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:23 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Volume volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 (72804051-6456-4c61-a518-4ddb1ce6d4b3): created successfully Sep 16 16:11:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e55b12f-8a11-4a0d-ae5b-d6a64df52dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Flow 'volume_create_manager' (4a7968ff-d188-47ad-b2b0-5cb5e866dddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:11:23 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-010a06e6-f22f-4145-bcff-a2de1fca4bb2 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Created volume successfully. Sep 16 16:11:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-07554cf1-0e5b-490d-a76b-7e4c318ae628 req-473ad9c3-008c-4790-b5b4-7d8c6f88f7e6 tempest-TaggedAttachmentsTest-1853448199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-07554cf1-0e5b-490d-a76b-7e4c318ae628 req-473ad9c3-008c-4790-b5b4-7d8c6f88f7e6 tempest-TaggedAttachmentsTest-1853448199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-07554cf1-0e5b-490d-a76b-7e4c318ae628 req-473ad9c3-008c-4790-b5b4-7d8c6f88f7e6 tempest-TaggedAttachmentsTest-1853448199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-07554cf1-0e5b-490d-a76b-7e4c318ae628 req-473ad9c3-008c-4790-b5b4-7d8c6f88f7e6 tempest-TaggedAttachmentsTest-1853448199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-3e0e47a4-1155-4155-b15d-a6914a5407df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70d88c89-2c20-4070-81dc-e11651a626ae', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:11:24 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-07554cf1-0e5b-490d-a76b-7e4c318ae628 req-473ad9c3-008c-4790-b5b4-7d8c6f88f7e6 tempest-TaggedAttachmentsTest-1853448199 None] attachment_update completed successfully. Sep 16 16:11:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Acquiring lock "cinder-72804051-6456-4c61-a518-4ddb1ce6d4b3-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:11:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "cinder-72804051-6456-4c61-a518-4ddb1ce6d4b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:11:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Acquiring lock "cinder-quobyte-72804051-6456-4c61-a518-4ddb1ce6d4b3" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:11:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "cinder-quobyte-72804051-6456-4c61-a518-4ddb1ce6d4b3" acquired by "delete_volume" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:11:25 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4035a3e8-550f-43b0-9865-902a9a158ad1]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:11:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:25 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 Sep 16 16:11:25 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:26 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3" returned: 0 in 0.922s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:26 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3 Sep 16 16:11:26 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:26 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-72804051-6456-4c61-a518-4ddb1ce6d4b3" returned: 0 in 0.702s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "cinder-quobyte-72804051-6456-4c61-a518-4ddb1ce6d4b3" released by "delete_volume" :: held 1.832s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Created reservations ['ecaf3a69-b75b-48fb-a9d7-3cf5cfa888f0', '90dd5452-e8d4-4dc3-8cbd-98cda546cd32', '3becd488-1745-4b32-aaed-fddd35cc4732', 'deec8021-282a-484c-b8fd-7ab3bb3e3e01'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:27 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:11:27 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:27 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.401s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:11:27 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Deleted volume successfully. Sep 16 16:11:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-12ea70a6-35b8-4299-9094-2b86c8bc96bb tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "cinder-72804051-6456-4c61-a518-4ddb1ce6d4b3-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Flow 'volume_create_manager' (0147d808-57e2-4d0b-a7f0-19a67dbf171b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c98e592-caf1-481e-af84-0d9ad9f1bf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c98e592-caf1-481e-af84-0d9ad9f1bf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-319684439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a76ed0b-9705-44ef-a3c0-e43cfbf26e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d1072690a2414a9675d1c7bfc75cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:28Z,use_quota=True,user_id='adb16c558a434f369bb8a0e042727d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc97b4f-98ee-45c4-803d-14dc59ba57c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc97b4f-98ee-45c4-803d-14dc59ba57c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263d52fb-228a-4aa2-89a1-f252a00eb40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263d52fb-228a-4aa2-89a1-f252a00eb40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a76ed0b-9705-44ef-a3c0-e43cfbf26e34', 'volume_name': 'volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15619387-3b49-4343-b07e-27b3981e17c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15619387-3b49-4343-b07e-27b3981e17c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd081113-e4e0-451a-84ca-977f5d7c36e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:28 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Volume 8a76ed0b-9705-44ef-a3c0-e43cfbf26e34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34', 'volume_size': 1} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-319684439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a76ed0b-9705-44ef-a3c0-e43cfbf26e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d1072690a2414a9675d1c7bfc75cfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:28Z,use_quota=True,user_id='adb16c558a434f369bb8a0e042727d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Creating volume 8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:11:28 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:11:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:28 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 1073741824 Sep 16 16:11:28 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:29 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 1073741824" returned: 0 in 0.690s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:29 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 Sep 16 16:11:29 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:29 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34" returned: 0 in 0.432s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-9bc96c07-a2da-44ee-ad3e-811698d09674 req-ac3a4c27-a29e-49ab-af48-a9db5a84c8fd tempest-TaggedAttachmentsTest-1853448199 None] Terminate volume connection completed successfully. Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-9bc96c07-a2da-44ee-ad3e-811698d09674 req-ac3a4c27-a29e-49ab-af48-a9db5a84c8fd tempest-TaggedAttachmentsTest-1853448199 None] Deleting attachment 70d88c89-2c20-4070-81dc-e11651a626ae. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd081113-e4e0-451a-84ca-977f5d7c36e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577a8a9c-5d9c-4271-9089-4da8d7b4379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:29 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Volume volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 (8a76ed0b-9705-44ef-a3c0-e43cfbf26e34): created successfully Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (577a8a9c-5d9c-4271-9089-4da8d7b4379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Flow 'volume_create_manager' (0147d808-57e2-4d0b-a7f0-19a67dbf171b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:11:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a9dc1b85-12df-4be3-9f8a-49fd3a79d524 tempest-VolumeQuotasAdminTestJSON-1359364368 None] Created volume successfully. Sep 16 16:11:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-524c4c7c-df08-4faf-a057-0056cf1f4ea7 tempest-VolumeQuotasAdminTestJSON-1002899351 None] Transfer volume completed successfully. Sep 16 16:11:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Acquiring lock "cinder-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:11:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Lock "cinder-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:11:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Acquiring lock "cinder-quobyte-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:11:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Lock "cinder-quobyte-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:11:34 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac334ef-1a3b-42ef-a07a-c4b4a28f55bf]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:11:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:34 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 Sep 16 16:11:34 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:34 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34" returned: 0 in 0.581s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:34 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34 Sep 16 16:11:34 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:35 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34" returned: 0 in 0.424s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Lock "cinder-quobyte-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34" released by "delete_volume" :: held 1.152s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Created reservations ['2c962b3a-70d8-4e67-8933-07a08425f2cd', 'b69d9464-81f3-44a1-8d4d-d6837c0eda71', '624f40cd-5d77-4a06-8cd2-ee776d89a2c5', 'a2074bfa-7070-4216-8d15-5aa2fbfa6747'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:35 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:11:35 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:35 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.482s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:11:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Deleted volume successfully. Sep 16 16:11:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6caac215-9f83-4722-a9e6-283dfeb94d88 tempest-VolumeQuotasAdminTestJSON-1518117702 None] Lock "cinder-8a76ed0b-9705-44ef-a3c0-e43cfbf26e34-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:11:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:11:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:11:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:11:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:41 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:11:41 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:42 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.313s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:11:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:11:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 8 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:11:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:11:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Acquiring lock "cinder-3e0e47a4-1155-4155-b15d-a6914a5407df-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:11:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Lock "cinder-3e0e47a4-1155-4155-b15d-a6914a5407df-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:11:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Acquiring lock "cinder-quobyte-3e0e47a4-1155-4155-b15d-a6914a5407df" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:11:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Lock "cinder-quobyte-3e0e47a4-1155-4155-b15d-a6914a5407df" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:11:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[35445454-8aca-4633-b690-23cb9aafd132]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:11:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:44 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df Sep 16 16:11:44 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:44 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df" returned: 0 in 0.446s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:44 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df Sep 16 16:11:44 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:44 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e0e47a4-1155-4155-b15d-a6914a5407df" returned: 0 in 0.341s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Lock "cinder-quobyte-3e0e47a4-1155-4155-b15d-a6914a5407df" released by "delete_volume" :: held 0.839s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:11:44 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Created reservations ['d8f85b99-b7a6-4976-b4ff-ccdf340a76c3', 'd65c2842-14b5-4376-9950-3e904ccb8a4a', '8810ff61-c183-47aa-8ef3-c75e5961da33', '6a7ba1ec-e950-4e0a-bebc-5a675621dcae'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:11:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:11:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:11:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:45 devstack sudo[90055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:11:45 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:45 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.498s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:45 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:11:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Deleted volume successfully. Sep 16 16:11:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0cca013-5299-46e3-8313-2011061a09ed tempest-TaggedAttachmentsTest-1853448199 None] Lock "cinder-3e0e47a4-1155-4155-b15d-a6914a5407df-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Flow 'volume_create_manager' (c0a1a811-b9b7-4eeb-aaf9-44f1aaf83c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36cc455-40b8-4620-8261-a30628fe2dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36cc455-40b8-4620-8261-a30628fe2dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1117537859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deeeabb2-603e-48ae-bc18-9e87af7113fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c834189ea344b3cb7343254fd19c810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:47Z,use_quota=True,user_id='e1555d21e27b4971bcbef65bd3071e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c02119-7c3b-4981-acd3-f0400ce63c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c02119-7c3b-4981-acd3-f0400ce63c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed1d076-031a-4c04-95bf-c032e6f23ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed1d076-031a-4c04-95bf-c032e6f23ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deeeabb2-603e-48ae-bc18-9e87af7113fa', 'volume_name': 'volume-deeeabb2-603e-48ae-bc18-9e87af7113fa', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dfabdd-24bc-4bc2-9b77-bc41e961671c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dfabdd-24bc-4bc2-9b77-bc41e961671c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e78995-4362-47ed-a3f7-33e6d639fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:47 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Volume deeeabb2-603e-48ae-bc18-9e87af7113fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deeeabb2-603e-48ae-bc18-9e87af7113fa', 'volume_size': 1} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1117537859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deeeabb2-603e-48ae-bc18-9e87af7113fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c834189ea344b3cb7343254fd19c810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:11:47Z,use_quota=True,user_id='e1555d21e27b4971bcbef65bd3071e11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Creating volume deeeabb2-603e-48ae-bc18-9e87af7113fa {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:11:47 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:47 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa 1073741824 Sep 16 16:11:47 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:47 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa 1073741824" returned: 0 in 0.597s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:48 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa Sep 16 16:11:48 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:48 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa" returned: 0 in 0.301s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:11:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e78995-4362-47ed-a3f7-33e6d639fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deeeabb2-603e-48ae-bc18-9e87af7113fa', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856aaf27-c8c5-4dda-b67f-a2de34b7312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:11:48 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Volume volume-deeeabb2-603e-48ae-bc18-9e87af7113fa (deeeabb2-603e-48ae-bc18-9e87af7113fa): created successfully Sep 16 16:11:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856aaf27-c8c5-4dda-b67f-a2de34b7312c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:11:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Flow 'volume_create_manager' (c0a1a811-b9b7-4eeb-aaf9-44f1aaf83c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:11:48 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2f5ee9a8-fadd-417a-b5be-79bb2540856b tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Created volume successfully. Sep 16 16:11:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Acquiring lock "cinder-deeeabb2-603e-48ae-bc18-9e87af7113fa-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:11:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "cinder-deeeabb2-603e-48ae-bc18-9e87af7113fa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:11:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Acquiring lock "cinder-quobyte-deeeabb2-603e-48ae-bc18-9e87af7113fa" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:11:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "cinder-quobyte-deeeabb2-603e-48ae-bc18-9e87af7113fa" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:11:50 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5875586-f0aa-4228-a8c2-1c08029a20ed]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:11:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:50 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa Sep 16 16:11:50 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:51 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa" returned: 0 in 0.445s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:51 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa Sep 16 16:11:51 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:51 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-deeeabb2-603e-48ae-bc18-9e87af7113fa" returned: 0 in 0.282s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "cinder-quobyte-deeeabb2-603e-48ae-bc18-9e87af7113fa" released by "delete_volume" :: held 0.780s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Created reservations ['269fb174-1fb1-4d7c-b8d2-4828137b508b', 'd0d1c2b7-9733-48a7-abd2-4463ea28b238', 'af41d6c9-4fa0-47c4-80e5-abb64370e147', 'f3c1e127-1bca-43a1-8838-be6690a42786'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:11:51 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:11:51 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:11:51 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.365s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:11:51 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Deleted volume successfully. Sep 16 16:11:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2feffeec-6668-46ba-93a2-2ba5689e4e11 tempest-VolumeQuotasNegativeTestJSON-1900780214 None] Lock "cinder-deeeabb2-603e-48ae-bc18-9e87af7113fa-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:11:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-97c3904b-0e17-42be-9848-da302d463017 req-77d8aab1-8937-4256-8f4f-7803aeac445c tempest-AttachVolumeNegativeTest-1290048330 None] Terminate volume connection completed successfully. Sep 16 16:11:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-97c3904b-0e17-42be-9848-da302d463017 req-77d8aab1-8937-4256-8f4f-7803aeac445c tempest-AttachVolumeNegativeTest-1290048330 None] Deleting attachment 6de2abc6-c027-4542-8604-15676c0f217f. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:12:02 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=35,cinder:UPDATE=42,cinder:DELETE=2,cinder:INSERT=10 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:12:02 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=44,cinder:SELECT=36,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Flow 'volume_create_manager' (ef35ac3c-be87-4fa3-a39b-a040ec3494eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b5251e-57cd-4580-8edd-7f0ae366e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b5251e-57cd-4580-8edd-7f0ae366e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1624142278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfb292f-7147-4197-9725-ff897e16d394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4161a5debc41cd9402ca64c255d176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:04Z,use_quota=True,user_id='bfaf69c27d8d4f7199abe1f23a9c4241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3de2f2-8624-471b-8019-ef7defc54f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3de2f2-8624-471b-8019-ef7defc54f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915be82f-e68c-4e8a-9943-02522746efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915be82f-e68c-4e8a-9943-02522746efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adfb292f-7147-4197-9725-ff897e16d394', 'volume_name': 'volume-adfb292f-7147-4197-9725-ff897e16d394', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a16daf-d0ee-4f76-b90e-e8aec0251beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a16daf-d0ee-4f76-b90e-e8aec0251beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55d124d-082c-4c79-93e8-5b90f3c2d5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:03 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Volume adfb292f-7147-4197-9725-ff897e16d394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adfb292f-7147-4197-9725-ff897e16d394', 'volume_size': 1} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1624142278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfb292f-7147-4197-9725-ff897e16d394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4161a5debc41cd9402ca64c255d176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:04Z,use_quota=True,user_id='bfaf69c27d8d4f7199abe1f23a9c4241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Creating volume adfb292f-7147-4197-9725-ff897e16d394 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:12:03 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:12:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:03 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394 1073741824 Sep 16 16:12:03 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:04 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394 1073741824" returned: 0 in 0.615s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:04 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394 Sep 16 16:12:04 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:04 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394" returned: 0 in 0.340s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:12:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55d124d-082c-4c79-93e8-5b90f3c2d5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adfb292f-7147-4197-9725-ff897e16d394', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707cf1d0-d494-4be0-9583-095d7a497082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:04 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Volume volume-adfb292f-7147-4197-9725-ff897e16d394 (adfb292f-7147-4197-9725-ff897e16d394): created successfully Sep 16 16:12:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707cf1d0-d494-4be0-9583-095d7a497082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Flow 'volume_create_manager' (ef35ac3c-be87-4fa3-a39b-a040ec3494eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:04 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b246fff0-966e-4756-a611-fec6aabeb0a6 tempest-AttachVolumeTestJSON-933576402 None] Created volume successfully. Sep 16 16:12:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-8e60d5f1-43e8-4539-ad15-c39b465056d2 req-5009a630-f54d-4722-b564-bfbfb836103e tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-8e60d5f1-43e8-4539-ad15-c39b465056d2 req-5009a630-f54d-4722-b564-bfbfb836103e tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-8e60d5f1-43e8-4539-ad15-c39b465056d2 req-5009a630-f54d-4722-b564-bfbfb836103e tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-8e60d5f1-43e8-4539-ad15-c39b465056d2 req-5009a630-f54d-4722-b564-bfbfb836103e tempest-AttachVolumeTestJSON-933576402 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-adfb292f-7147-4197-9725-ff897e16d394', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '682e76ff-65a6-4d2f-a177-e7f3194769e1', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:12:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-8e60d5f1-43e8-4539-ad15-c39b465056d2 req-5009a630-f54d-4722-b564-bfbfb836103e tempest-AttachVolumeTestJSON-933576402 None] attachment_update completed successfully. Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Flow 'volume_create_manager' (287226ec-26a1-4eaf-aba5-818edc83e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8cb1fc-5e8b-48ce-b5dd-781fdadc0fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8cb1fc-5e8b-48ce-b5dd-781fdadc0fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-687233581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3eb120-5bcd-416a-9065-a7e7ed7795fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8800faba84204dd6a718717032d2575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:08Z,use_quota=True,user_id='d835c4f4422b451c948befeaa981b3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e803df79-dd86-41b2-b0d8-b230d9933d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e803df79-dd86-41b2-b0d8-b230d9933d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d637b5-9182-42af-9088-e4d2e3415fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2d637b5-9182-42af-9088-e4d2e3415fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5a3eb120-5bcd-416a-9065-a7e7ed7795fa', 'volume_name': 'volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f42c29-8a69-44fd-9f36-0c65f20c7cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48f42c29-8a69-44fd-9f36-0c65f20c7cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4784e8aa-d2c4-428e-8f45-649332a1f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:08 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Volume 5a3eb120-5bcd-416a-9065-a7e7ed7795fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 16:12:08 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Trying to clone 5a3eb120-5bcd-416a-9065-a7e7ed7795fa from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:12:09 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:12:09 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Image download 20.69 MB at 20.69 MB/s Sep 16 16:12:09 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3056fe6f-e47f-431b-9bac-43baef9160b8]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:12:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:09 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD Sep 16 16:12:09 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:09 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c is fetched for user d835c4f4422b451c948befeaa981b3e9. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f968ee3-52ca-4cc5-8f84-dc0651e24407]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:10 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD Sep 16 16:12:10 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:10 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-687233581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3eb120-5bcd-416a-9065-a7e7ed7795fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8800faba84204dd6a718717032d2575d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:08Z,use_quota=True,user_id='d835c4f4422b451c948befeaa981b3e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Creating volume 5a3eb120-5bcd-416a-9065-a7e7ed7795fa {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:12:10 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:12:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:10 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa 1073741824 Sep 16 16:12:10 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:11 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa 1073741824" returned: 0 in 0.603s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:11 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa Sep 16 16:12:11 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:11 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa" returned: 0 in 0.401s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:12:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:11 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Attempting download of cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume 5a3eb120-5bcd-416a-9065-a7e7ed7795fa. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:12:11 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f00883-2720-4d3a-b4c4-4036bef71d0a]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:12:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_i20dkkkk {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:11 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_i20dkkkk Sep 16 16:12:11 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:12 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_i20dkkkk" returned: 0 in 0.371s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_i20dkkkk {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:12 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_i20dkkkk Sep 16 16:12:12 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:12 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_i20dkkkk" returned: 1 in 0.348s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_i20dkkkk' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:12:12 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f13d83-f2ba-4346-b002-019da0629852]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:12:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:12 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD Sep 16 16:12:12 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:12 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:12 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] cceeac4d-0fa7-4694-a045-5c6e3d003f4c was qcow2, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:12:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:12 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa Sep 16 16:12:12 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:16 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa" returned: 0 in 3.099s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_kfrt5t6ldevstack@QuobyteHD, size 112.00 MB, duration 3.10 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:12:16 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Converted 112.00 MB image at 36.13 MB/s Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:16 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa 1G Sep 16 16:12:16 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:16 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa 1G" returned: 0 in 0.665s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Downloaded image cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume 5a3eb120-5bcd-416a-9065-a7e7ed7795fa successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c for user d835c4f4422b451c948befeaa981b3e9 is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Marking volume 5a3eb120-5bcd-416a-9065-a7e7ed7795fa as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Copying metadata from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c to 5a3eb120-5bcd-416a-9065-a7e7ed7795fa. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Creating volume glance metadata for volume 5a3eb120-5bcd-416a-9065-a7e7ed7795fa backed by image cceeac4d-0fa7-4694-a045-5c6e3d003f4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4784e8aa-d2c4-428e-8f45-649332a1f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393a804b-f98c-4873-93b6-7a7fae316d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:16 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Volume volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa (5a3eb120-5bcd-416a-9065-a7e7ed7795fa): created successfully Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (393a804b-f98c-4873-93b6-7a7fae316d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Flow 'volume_create_manager' (287226ec-26a1-4eaf-aba5-818edc83e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f7d09ba5-211f-4981-91c5-acd375d6761e tempest-VolumesImageMetadata-1530911578 None] Created volume successfully. Sep 16 16:12:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Acquiring lock "cinder-5a3eb120-5bcd-416a-9065-a7e7ed7795fa-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:12:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Lock "cinder-5a3eb120-5bcd-416a-9065-a7e7ed7795fa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:12:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Acquiring lock "cinder-quobyte-5a3eb120-5bcd-416a-9065-a7e7ed7795fa" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:12:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Lock "cinder-quobyte-5a3eb120-5bcd-416a-9065-a7e7ed7795fa" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:12:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df94d92-32ab-4725-871a-cd7ea039f283]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:12:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:19 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa Sep 16 16:12:19 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:20 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa" returned: 0 in 0.859s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:20 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa Sep 16 16:12:20 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:20 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5a3eb120-5bcd-416a-9065-a7e7ed7795fa" returned: 0 in 0.401s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Lock "cinder-quobyte-5a3eb120-5bcd-416a-9065-a7e7ed7795fa" released by "delete_volume" :: held 1.399s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Created reservations ['df11b915-cbd8-4788-a5b8-a37d9735b98e', '4728995a-bca3-4d64-8a51-9f7226bada68', '1115a9f8-4055-405e-a086-a66dc7b3da8c', 'ab57c82e-0116-4c41-a4b8-a1b5d8ee88b6'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:20 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:12:20 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:21 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.782s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:21 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:12:21 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Deleted volume successfully. Sep 16 16:12:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-45db64cf-9a3e-410d-84cd-4276dad02268 tempest-VolumesImageMetadata-1530911578 None] Lock "cinder-5a3eb120-5bcd-416a-9065-a7e7ed7795fa-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:12:30 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=23,cinder:UPDATE=17,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:12:31 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=17,cinder:INSERT=10,cinder:DELETE=2,cinder:SELECT=23 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Flow 'volume_create_manager' (6a6fc52d-5880-4766-bb24-879a602b1b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbd5988-2730-4b04-996b-88c424536c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbd5988-2730-4b04-996b-88c424536c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-603337827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058b7ef2-8de9-4f04-a113-ffe415fe0474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb825aac006b419c987661aa960f52e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:34Z,use_quota=True,user_id='bdd5a1f0b90c43cda068040cb79f32c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd85b93-a105-4a73-96a9-d26a85300cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd85b93-a105-4a73-96a9-d26a85300cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d75461-a8c8-489a-be3d-86a64d7a29df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d75461-a8c8-489a-be3d-86a64d7a29df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '058b7ef2-8de9-4f04-a113-ffe415fe0474', 'volume_name': 'volume-058b7ef2-8de9-4f04-a113-ffe415fe0474', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d2ccb0-a3f5-43c9-8323-313345980ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d2ccb0-a3f5-43c9-8323-313345980ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3355f641-7cba-46e4-8b9e-b62ac1b1241c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Volume 058b7ef2-8de9-4f04-a113-ffe415fe0474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-058b7ef2-8de9-4f04-a113-ffe415fe0474', 'volume_size': 1} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-603337827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058b7ef2-8de9-4f04-a113-ffe415fe0474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb825aac006b419c987661aa960f52e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:34Z,use_quota=True,user_id='bdd5a1f0b90c43cda068040cb79f32c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Creating volume 058b7ef2-8de9-4f04-a113-ffe415fe0474 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:12:34 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:34 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 1073741824 Sep 16 16:12:34 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:34 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 1073741824" returned: 0 in 0.617s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:34 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 Sep 16 16:12:34 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:35 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474" returned: 0 in 0.486s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:12:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3355f641-7cba-46e4-8b9e-b62ac1b1241c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058b7ef2-8de9-4f04-a113-ffe415fe0474', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b999435-811a-48ce-8e76-19c7c10bc762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Volume volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 (058b7ef2-8de9-4f04-a113-ffe415fe0474): created successfully Sep 16 16:12:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b999435-811a-48ce-8e76-19c7c10bc762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Flow 'volume_create_manager' (6a6fc52d-5880-4766-bb24-879a602b1b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7c7e78af-0656-4766-8450-198dcd071773 tempest-SnapshotMetadataTestJSON-653059533 None] Created volume successfully. Sep 16 16:12:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Creating offline snapshot 803fa47b-edc6-4a38-8b26-b36ece113447 of volume 058b7ef2-8de9-4f04-a113-ffe415fe0474 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:12:36 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc68455c-61c9-4f05-b222-6da17a9125bb]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:12:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:36 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 Sep 16 16:12:36 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:37 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474" returned: 0 in 0.598s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:37 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 1G Sep 16 16:12:37 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:38 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 1G" returned: 0 in 0.677s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:38 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 Sep 16 16:12:38 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:38 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447" returned: 0 in 0.319s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:38 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 is being set with open permissions: ugo+rw Sep 16 16:12:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:38 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 Sep 16 16:12:38 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:38 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447" returned: 0 in 0.314s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:38 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.info Sep 16 16:12:38 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:39 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.info" returned: 0 in 0.370s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:39 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.info is being set with open permissions: ugo+rw Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:39 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.info Sep 16 16:12:39 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:39 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.info" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:39 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6066306e-7493-440f-b49a-81769b9249f9 tempest-SnapshotMetadataTestJSON-653059533 None] Create snapshot completed successfully Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Flow 'volume_create_manager' (f94c5646-5bb6-4a0a-a832-32f60a522d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09e1cee-e3b1-4ba3-8986-dee8ca070162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09e1cee-e3b1-4ba3-8986-dee8ca070162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-881070119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223c983b-ac6b-495a-8bfc-4dc74fc06df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3122a85bf0b409d94e1dd4fa2c7b3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:40Z,use_quota=True,user_id='4c36f6c382af40c5a813c8d69dd94a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f7d71f-f432-44e5-aeac-53887f6566ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f7d71f-f432-44e5-aeac-53887f6566ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed5b52b-d366-4009-8eb1-e9707ef20769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed5b52b-d366-4009-8eb1-e9707ef20769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223c983b-ac6b-495a-8bfc-4dc74fc06df3', 'volume_name': 'volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5e6b8c-a32a-4627-8b46-bb293a183bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5e6b8c-a32a-4627-8b46-bb293a183bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd0c048-371d-45c1-867b-31d68830d826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:39 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Volume 223c983b-ac6b-495a-8bfc-4dc74fc06df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3', 'volume_size': 1} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-881070119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223c983b-ac6b-495a-8bfc-4dc74fc06df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3122a85bf0b409d94e1dd4fa2c7b3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:40Z,use_quota=True,user_id='4c36f6c382af40c5a813c8d69dd94a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Creating volume 223c983b-ac6b-495a-8bfc-4dc74fc06df3 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:12:39 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:12:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:39 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 1073741824 Sep 16 16:12:39 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:40 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 1073741824" returned: 0 in 0.540s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:40 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 Sep 16 16:12:40 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:40 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3" returned: 0 in 0.355s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Acquiring lock "cinder-803fa47b-edc6-4a38-8b26-b36ece113447-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd0c048-371d-45c1-867b-31d68830d826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a8c18c-8ea0-46f2-bd69-9ef3a74a72f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-803fa47b-edc6-4a38-8b26-b36ece113447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Acquiring lock "cinder-quobyte-058b7ef2-8de9-4f04-a113-ffe415fe0474" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:12:40 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Volume volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 (223c983b-ac6b-495a-8bfc-4dc74fc06df3): created successfully Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a8c18c-8ea0-46f2-bd69-9ef3a74a72f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Flow 'volume_create_manager' (f94c5646-5bb6-4a0a-a832-32f60a522d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-quobyte-058b7ef2-8de9-4f04-a113-ffe415fe0474" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Acquiring lock "cinder-quobyte-803fa47b-edc6-4a38-8b26-b36ece113447" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:12:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-14949894-bb45-4c2b-8655-02350dd97215 tempest-AttachVolumeNegativeTest-1290048330 None] Created volume successfully. Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-quobyte-803fa47b-edc6-4a38-8b26-b36ece113447" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Deleting offline snapshot 803fa47b-edc6-4a38-8b26-b36ece113447 of volume 058b7ef2-8de9-4f04-a113-ffe415fe0474 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] snapshot_file for this snap is: volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c5596-de11-4312-a9c4-69fe34b16d96]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:12:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:40 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 Sep 16 16:12:40 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:41 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447" returned: 0 in 0.373s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-058b7ef2-8de9-4f04-a113-ffe415fe0474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8514e2c8-34d5-45b6-a5f3-4bee98f010e3]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:41 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 Sep 16 16:12:41 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:41 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474" returned: 0 in 0.371s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:41 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 Sep 16 16:12:41 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:41 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:12:41 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:41 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.288s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:41 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:12:42 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447" returned: 0 in 0.409s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:42 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447 Sep 16 16:12:42 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:42 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474.803fa47b-edc6-4a38-8b26-b36ece113447" returned: 0 in 0.356s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-quobyte-803fa47b-edc6-4a38-8b26-b36ece113447" released by "_delete_snapshot" :: held 1.649s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-quobyte-058b7ef2-8de9-4f04-a113-ffe415fe0474" released by "delete_snapshot" :: held 1.680s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:12:42 devstack cinder-volume[86255]: WARNING cinder.quota [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Created reservations ['75f33d9c-0774-458c-8c16-edf2266ec9d8', '19ca953f-12ae-41b3-851b-1fda5d9900cf', 'a5a5cbb8-12a0-4a62-9bcc-a68e0b25e13b', 'db67161c-ad4f-4fc1-bf87-7feb1e57ecdc'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-5b9b35f3-cd7b-4448-aaef-5e5ff34bf49d req-5239302b-5ef2-4729-8afc-7f48a43d8c29 tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-5b9b35f3-cd7b-4448-aaef-5e5ff34bf49d req-5239302b-5ef2-4729-8afc-7f48a43d8c29 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Delete snapshot completed successfully. Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbb044b2-f887-49e7-90a6-df1079bc7f72 tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-803fa47b-edc6-4a38-8b26-b36ece113447-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-5b9b35f3-cd7b-4448-aaef-5e5ff34bf49d req-5239302b-5ef2-4729-8afc-7f48a43d8c29 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-5b9b35f3-cd7b-4448-aaef-5e5ff34bf49d req-5239302b-5ef2-4729-8afc-7f48a43d8c29 tempest-AttachVolumeNegativeTest-1290048330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba21ee8c-936f-4ef1-a08d-136c3a55e56f', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:12:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-5b9b35f3-cd7b-4448-aaef-5e5ff34bf49d req-5239302b-5ef2-4729-8afc-7f48a43d8c29 tempest-AttachVolumeNegativeTest-1290048330 None] attachment_update completed successfully. Sep 16 16:12:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Acquiring lock "cinder-058b7ef2-8de9-4f04-a113-ffe415fe0474-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:12:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-058b7ef2-8de9-4f04-a113-ffe415fe0474-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:12:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Acquiring lock "cinder-quobyte-058b7ef2-8de9-4f04-a113-ffe415fe0474" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:12:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-quobyte-058b7ef2-8de9-4f04-a113-ffe415fe0474" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:12:43 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa44e87-7e4b-43bb-8923-b8bd10c87dc9]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:12:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:43 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 Sep 16 16:12:43 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:43 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474" returned: 0 in 0.637s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:43 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474 Sep 16 16:12:43 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:44 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-058b7ef2-8de9-4f04-a113-ffe415fe0474" returned: 0 in 0.424s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-quobyte-058b7ef2-8de9-4f04-a113-ffe415fe0474" released by "delete_volume" :: held 1.177s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Created reservations ['c93a4528-97fe-45f4-acd7-f3f56bba9ebd', '70bfe2df-c4b8-4cab-9768-fce2df70531b', 'dc9a01ad-76a7-44f8-b3b4-7f3eb4d33165', '16a3aa15-ba70-476f-977c-d8eb82b50b5f'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:44 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:12:44 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:44 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-1d4d3194-9508-46e8-9d1b-6c34ebf3ebb0 req-b756a3b2-420d-4674-8c2b-7a7ebbe71e74 tempest-AttachVolumeNegativeTest-1290048330 None] Terminate volume connection completed successfully. Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-1d4d3194-9508-46e8-9d1b-6c34ebf3ebb0 req-b756a3b2-420d-4674-8c2b-7a7ebbe71e74 tempest-AttachVolumeNegativeTest-1290048330 None] Deleting attachment ba21ee8c-936f-4ef1-a08d-136c3a55e56f. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.304s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:12:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Deleted volume successfully. Sep 16 16:12:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54a179fa-4a41-4b53-b23f-8a0aa026d8ee tempest-SnapshotMetadataTestJSON-653059533 None] Lock "cinder-058b7ef2-8de9-4f04-a113-ffe415fe0474-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:12:49 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:12:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Flow 'volume_create_manager' (25e6ba4e-262b-4988-9f81-a0467a656c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1962560c-e109-4847-8e2e-69bed382016f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1962560c-e109-4847-8e2e-69bed382016f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1414676861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7250e864-2bce-42c7-a758-3d3a0dc70c6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21ff26e3831746b18efdee06ad34f633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:50Z,use_quota=True,user_id='534370bd6d5d4adcafc4b48871235c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d056846-288a-4c04-b5b2-c37689936a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d056846-288a-4c04-b5b2-c37689936a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a11ae9-5f90-44f3-b3d9-b2a9d0c51002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a11ae9-5f90-44f3-b3d9-b2a9d0c51002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7250e864-2bce-42c7-a758-3d3a0dc70c6d', 'volume_name': 'volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20add85-73c1-495c-91fe-5fae4fc04787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20add85-73c1-495c-91fe-5fae4fc04787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0319d743-4730-41f4-8c10-e4bae7dfdb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:50 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Volume 7250e864-2bce-42c7-a758-3d3a0dc70c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d', 'volume_size': 1} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1414676861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7250e864-2bce-42c7-a758-3d3a0dc70c6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21ff26e3831746b18efdee06ad34f633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:50Z,use_quota=True,user_id='534370bd6d5d4adcafc4b48871235c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Creating volume 7250e864-2bce-42c7-a758-3d3a0dc70c6d {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:12:50 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:50 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d 1073741824 Sep 16 16:12:50 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:50 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d 1073741824" returned: 0 in 0.531s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:50 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d Sep 16 16:12:50 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:50 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d" returned: 0 in 0.331s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:12:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0319d743-4730-41f4-8c10-e4bae7dfdb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1360fc-cbb9-4a7b-93ba-0b06b3ef8fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:51 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Volume volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d (7250e864-2bce-42c7-a758-3d3a0dc70c6d): created successfully Sep 16 16:12:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1360fc-cbb9-4a7b-93ba-0b06b3ef8fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Flow 'volume_create_manager' (25e6ba4e-262b-4988-9f81-a0467a656c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:51 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1db0b06d-4bdd-474d-bdc7-db6f33f7474d tempest-VolumesListTestJSON-1299263697 None] Created volume successfully. Sep 16 16:12:51 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-2a926c18-3f03-42df-8c05-e5ae9508930e req-e901bd9c-c424-46af-b724-89aa4e0ece22 tempest-AttachVolumeTestJSON-933576402 None] Terminate volume connection completed successfully. Sep 16 16:12:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-2a926c18-3f03-42df-8c05-e5ae9508930e req-e901bd9c-c424-46af-b724-89aa4e0ece22 tempest-AttachVolumeTestJSON-933576402 None] Deleting attachment 682e76ff-65a6-4d2f-a177-e7f3194769e1. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Flow 'volume_create_manager' (f5f81b6c-6012-4d09-9723-4de82f40decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6333693e-a983-487d-9cd7-6c1c18e4ca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6333693e-a983-487d-9cd7-6c1c18e4ca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-850689732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584d79b0-7f33-4c27-af36-e50cd4e91513,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21ff26e3831746b18efdee06ad34f633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:53Z,use_quota=True,user_id='534370bd6d5d4adcafc4b48871235c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd7eabe-941c-42b7-b4b9-b747b0dcce00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd7eabe-941c-42b7-b4b9-b747b0dcce00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6aa64e-c39f-47f0-bdba-9861ba3be6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6aa64e-c39f-47f0-bdba-9861ba3be6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '584d79b0-7f33-4c27-af36-e50cd4e91513', 'volume_name': 'volume-584d79b0-7f33-4c27-af36-e50cd4e91513', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eefcca8-e43b-4fc2-b37b-7e201f03ad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eefcca8-e43b-4fc2-b37b-7e201f03ad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b5985-4946-47c0-a38e-35dbaa32d8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:52 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Volume 584d79b0-7f33-4c27-af36-e50cd4e91513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-584d79b0-7f33-4c27-af36-e50cd4e91513', 'volume_size': 1} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-850689732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584d79b0-7f33-4c27-af36-e50cd4e91513,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21ff26e3831746b18efdee06ad34f633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:53Z,use_quota=True,user_id='534370bd6d5d4adcafc4b48871235c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Creating volume 584d79b0-7f33-4c27-af36-e50cd4e91513 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:12:52 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:12:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:52 devstack sudo[91761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513 1073741824 Sep 16 16:12:52 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:53 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513 1073741824" returned: 0 in 0.472s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:53 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513 Sep 16 16:12:53 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:53 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513" returned: 0 in 0.336s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:12:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7b5985-4946-47c0-a38e-35dbaa32d8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584d79b0-7f33-4c27-af36-e50cd4e91513', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5189966-f39b-4ee3-876d-922512437447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Volume volume-584d79b0-7f33-4c27-af36-e50cd4e91513 (584d79b0-7f33-4c27-af36-e50cd4e91513): created successfully Sep 16 16:12:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5189966-f39b-4ee3-876d-922512437447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Flow 'volume_create_manager' (f5f81b6c-6012-4d09-9723-4de82f40decb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:53 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-47ed1d80-7a92-427e-bf30-9f1c1a8dfd2b tempest-VolumesListTestJSON-1299263697 None] Created volume successfully. Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Flow 'volume_create_manager' (500fabbc-c526-4f55-9ffa-8c8b1d5cb9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce563490-5576-42c9-8e26-571e9faae3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce563490-5576-42c9-8e26-571e9faae3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-676156458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce662510-e55c-4ae2-915b-1aaf861cbdd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21ff26e3831746b18efdee06ad34f633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:56Z,use_quota=True,user_id='534370bd6d5d4adcafc4b48871235c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3018ccd5-9312-4ebe-a570-77b66a8646f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3018ccd5-9312-4ebe-a570-77b66a8646f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e072e4-8ce6-44eb-b06a-ea76df1d07e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e072e4-8ce6-44eb-b06a-ea76df1d07e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce662510-e55c-4ae2-915b-1aaf861cbdd0', 'volume_name': 'volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f29f56b-0d35-4893-a2c1-ae35cc24ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f29f56b-0d35-4893-a2c1-ae35cc24ca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84804d0e-f0fb-4b6b-9c74-f5b3443da53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:56 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Volume ce662510-e55c-4ae2-915b-1aaf861cbdd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0', 'volume_size': 1} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-676156458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce662510-e55c-4ae2-915b-1aaf861cbdd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='21ff26e3831746b18efdee06ad34f633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:56Z,use_quota=True,user_id='534370bd6d5d4adcafc4b48871235c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Creating volume ce662510-e55c-4ae2-915b-1aaf861cbdd0 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:12:56 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:12:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:56 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 1073741824 Sep 16 16:12:56 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:57 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 1073741824" returned: 0 in 1.163s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:57 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 Sep 16 16:12:57 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Flow 'volume_create_manager' (f2b13dac-0240-41f3-8be7-4cd994d4bb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261bc215-a2da-465b-a224-cf75d1372273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (261bc215-a2da-465b-a224-cf75d1372273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-622667986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3edab7-5bc0-49f4-9e7d-e8c582de2f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67bf463e4294ffc908ea75253343c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:58Z,use_quota=True,user_id='305013e6f4e1441da40835126f0bdc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc85138-315d-4724-a58c-48c6a56e8507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc85138-315d-4724-a58c-48c6a56e8507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bca7629-becf-472f-9b7e-704525061010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:58 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bca7629-becf-472f-9b7e-704525061010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3edab7-5bc0-49f4-9e7d-e8c582de2f18', 'volume_name': 'volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778ab808-9f52-48ab-bbc5-d8e2bfbba415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778ab808-9f52-48ab-bbc5-d8e2bfbba415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0575912d-fbb4-4d15-ac52-dc80890d1ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:58 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Volume fc3edab7-5bc0-49f4-9e7d-e8c582de2f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18', 'volume_size': 1} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0" returned: 0 in 0.825s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.030s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-622667986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3edab7-5bc0-49f4-9e7d-e8c582de2f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67bf463e4294ffc908ea75253343c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:12:58Z,use_quota=True,user_id='305013e6f4e1441da40835126f0bdc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Creating volume fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:12:58 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84804d0e-f0fb-4b6b-9c74-f5b3443da53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:58 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 1073741824 Sep 16 16:12:58 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f9db15-1141-423d-8e3a-69a16690e1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:12:58 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Volume volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 (ce662510-e55c-4ae2-915b-1aaf861cbdd0): created successfully Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f9db15-1141-423d-8e3a-69a16690e1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:12:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Flow 'volume_create_manager' (500fabbc-c526-4f55-9ffa-8c8b1d5cb9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:12:58 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ccd5e61f-b7d0-4cf1-87b1-ef14e2ef7479 tempest-VolumesListTestJSON-1299263697 None] Created volume successfully. Sep 16 16:12:59 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Sep 16 16:12:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 1073741824" returned: 0 in 1.032s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:12:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:12:59 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 Sep 16 16:12:59 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:00 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18" returned: 0 in 0.585s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:13:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0575912d-fbb4-4d15-ac52-dc80890d1ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce970c92-c29f-4fa7-a017-e9f0c196a122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:00 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Volume volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 (fc3edab7-5bc0-49f4-9e7d-e8c582de2f18): created successfully Sep 16 16:13:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce970c92-c29f-4fa7-a017-e9f0c196a122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Flow 'volume_create_manager' (f2b13dac-0240-41f3-8be7-4cd994d4bb13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:13:00 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6dc05d89-d753-44d6-a408-62e511e9bff7 tempest-ServerActionsTestOtherA-2099364010 None] Created volume successfully. Sep 16 16:13:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "cinder-ce662510-e55c-4ae2-915b-1aaf861cbdd0-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-ce662510-e55c-4ae2-915b-1aaf861cbdd0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "cinder-quobyte-ce662510-e55c-4ae2-915b-1aaf861cbdd0" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-quobyte-ce662510-e55c-4ae2-915b-1aaf861cbdd0" acquired by "delete_volume" :: waited 0.079s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:03 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f24998-5db1-42b4-b2e5-60c662c91d33]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:03 devstack sudo[91939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 Sep 16 16:13:03 devstack sudo[91939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:04 devstack sudo[91939]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0" returned: 0 in 1.085s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:04 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0 Sep 16 16:13:04 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:05 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce662510-e55c-4ae2-915b-1aaf861cbdd0" returned: 0 in 0.466s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-quobyte-ce662510-e55c-4ae2-915b-1aaf861cbdd0" released by "delete_volume" :: held 1.667s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Created reservations ['856a296c-f0f6-444b-9799-ca219acccce4', '0dd45823-c0e5-4ad2-a3bd-311398435e19', 'a691cf54-a6dc-4fe5-9c5c-82b56e147819', 'ddad23ae-3d7a-4c50-97a7-fd4b84fab651'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:05 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:13:05 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:05 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.561s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:05 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:13:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Deleted volume successfully. Sep 16 16:13:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0afd63fa-6d6e-49ed-9b21-96313f809b1d tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-ce662510-e55c-4ae2-915b-1aaf861cbdd0-delete_volume" released by "delete_volume" :: held 4.378s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "cinder-584d79b0-7f33-4c27-af36-e50cd4e91513-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-584d79b0-7f33-4c27-af36-e50cd4e91513-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "cinder-quobyte-584d79b0-7f33-4c27-af36-e50cd4e91513" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-quobyte-584d79b0-7f33-4c27-af36-e50cd4e91513" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:10 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[498b0e6f-e349-454c-aa9c-ecc732f0ae75]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:10 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513 Sep 16 16:13:10 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:11 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513" returned: 0 in 0.394s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:11 devstack sudo[92002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513 Sep 16 16:13:11 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:11 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-584d79b0-7f33-4c27-af36-e50cd4e91513" returned: 0 in 0.254s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-quobyte-584d79b0-7f33-4c27-af36-e50cd4e91513" released by "delete_volume" :: held 0.772s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Created reservations ['e2c528b3-1113-4257-b73e-9aea30ccaa3b', 'b1e7df72-b903-49c8-ba96-01823b494679', '05db8bc9-366a-4a2f-9a8b-7da9bac46d0a', 'd5847368-89dd-4949-ac8a-0716165aefbc'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:11 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:13:11 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:12 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.391s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:12 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:13:12 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Deleted volume successfully. Sep 16 16:13:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d1c102a3-71f5-41e9-bf44-68f2b0f6f435 tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-584d79b0-7f33-4c27-af36-e50cd4e91513-delete_volume" released by "delete_volume" :: held 4.093s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "cinder-7250e864-2bce-42c7-a758-3d3a0dc70c6d-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-7250e864-2bce-42c7-a758-3d3a0dc70c6d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "cinder-quobyte-7250e864-2bce-42c7-a758-3d3a0dc70c6d" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-quobyte-7250e864-2bce-42c7-a758-3d3a0dc70c6d" acquired by "delete_volume" :: waited 0.043s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:12 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fa3dfc-1b3b-43c4-aaa2-4d13795bf119]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:13 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d Sep 16 16:13:13 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:13 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d" returned: 0 in 0.723s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:13 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d Sep 16 16:13:13 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:14 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7250e864-2bce-42c7-a758-3d3a0dc70c6d" returned: 0 in 0.598s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-quobyte-7250e864-2bce-42c7-a758-3d3a0dc70c6d" released by "delete_volume" :: held 1.416s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Created reservations ['e6c2d645-d976-4df0-b866-258360dd4d3f', '7e44cc96-31f3-47e1-a587-6ef24b7f0c55', '7f8b7aab-bb97-4073-a50b-e52dfda34092', 'ff4a11a3-5b4d-4b49-82dd-42800882165d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:14 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:13:14 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:14 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.300s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:13:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Deleted volume successfully. Sep 16 16:13:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-728750a9-9bcd-4db3-9682-bf5519c8778b tempest-VolumesListTestJSON-1299263697 None] Lock "cinder-7250e864-2bce-42c7-a758-3d3a0dc70c6d-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Flow 'volume_create_manager' (4a10e9bf-7d08-4bf6-ae9c-824050ada9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1405689-67be-46d1-a4c1-b1deb59508df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1405689-67be-46d1-a4c1-b1deb59508df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2086275341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabb765b-dee0-4328-869f-452bf5769f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2f8e7abdd54c92958241ef22bb4ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:21Z,use_quota=True,user_id='4111a8add8f540cdad50b56c0dfa14ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ec2cf3-f9bc-4fbe-821b-5c502701597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ec2cf3-f9bc-4fbe-821b-5c502701597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b054c935-a576-4847-909f-a9c8ddedd4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b054c935-a576-4847-909f-a9c8ddedd4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabb765b-dee0-4328-869f-452bf5769f1e', 'volume_name': 'volume-dabb765b-dee0-4328-869f-452bf5769f1e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65339556-9634-4145-a273-43eec4270470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65339556-9634-4145-a273-43eec4270470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b781a92-ea52-4c75-bf91-d7ce58996692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:21 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Volume dabb765b-dee0-4328-869f-452bf5769f1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabb765b-dee0-4328-869f-452bf5769f1e', 'volume_size': 1} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2086275341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabb765b-dee0-4328-869f-452bf5769f1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2f8e7abdd54c92958241ef22bb4ba1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:21Z,use_quota=True,user_id='4111a8add8f540cdad50b56c0dfa14ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Creating volume dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:13:21 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:13:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:22 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e 1073741824 Sep 16 16:13:22 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:22 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e 1073741824" returned: 0 in 0.859s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:22 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e Sep 16 16:13:22 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:23 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e" returned: 0 in 0.393s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b781a92-ea52-4c75-bf91-d7ce58996692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabb765b-dee0-4328-869f-452bf5769f1e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f500936a-a058-425d-8a2a-8e0744b92b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:23 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Volume volume-dabb765b-dee0-4328-869f-452bf5769f1e (dabb765b-dee0-4328-869f-452bf5769f1e): created successfully Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f500936a-a058-425d-8a2a-8e0744b92b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Flow 'volume_create_manager' (4a10e9bf-7d08-4bf6-ae9c-824050ada9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:13:23 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5322f468-d7d4-4255-a0db-cba7f1d5b2a3 tempest-VolumesSnapshotListTestJSON-260595977 None] Created volume successfully. Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Creating offline snapshot 429a8af2-0f98-4b36-82f5-159962d986e4 of volume dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d4e16-b80d-41bd-af02-b28677026ee0]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:23 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e Sep 16 16:13:23 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:24 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e" returned: 0 in 0.435s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:24 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 1G Sep 16 16:13:24 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:24 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 1G" returned: 0 in 0.499s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabb765b-dee0-4328-869f-452bf5769f1e -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:24 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabb765b-dee0-4328-869f-452bf5769f1e -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 Sep 16 16:13:24 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:25 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabb765b-dee0-4328-869f-452bf5769f1e -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4" returned: 0 in 0.309s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:25 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 is being set with open permissions: ugo+rw Sep 16 16:13:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:25 devstack sudo[92159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 Sep 16 16:13:25 devstack sudo[92159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:25 devstack sudo[92159]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4" returned: 0 in 0.343s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:25 devstack sudo[92163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.info Sep 16 16:13:25 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:25 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.info" returned: 0 in 0.462s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:25 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.info is being set with open permissions: ugo+rw Sep 16 16:13:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:25 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.info Sep 16 16:13:25 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:26 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.info" returned: 0 in 0.320s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:26 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a597b30a-08fb-41aa-a9ec-3cff022999fd tempest-VolumesSnapshotListTestJSON-260595977 None] Create snapshot completed successfully Sep 16 16:13:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Creating offline snapshot f960a1fb-4cad-4104-9c25-71ebaec07086 of volume dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:13:27 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5204172-8cba-403f-8922-cabc82b5aa23]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:27 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 Sep 16 16:13:27 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:27 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4" returned: 0 in 0.402s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabb765b-dee0-4328-869f-452bf5769f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:13:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:27 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 1G Sep 16 16:13:27 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:28 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 1G" returned: 0 in 0.473s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:28 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 Sep 16 16:13:28 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:28 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086" returned: 0 in 0.432s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:28 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 is being set with open permissions: ugo+rw Sep 16 16:13:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:28 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 Sep 16 16:13:28 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:28 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086" returned: 0 in 0.303s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.757s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7fcf902d-110c-455e-8bd6-25c9e86a2789 tempest-VolumesSnapshotListTestJSON-260595977 None] Create snapshot completed successfully Sep 16 16:13:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Creating offline snapshot 7f1b49df-2a23-4857-903c-aeee81af83ab of volume dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:13:29 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eabf62-7617-4415-a0f7-be85b6261480]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:29 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Flow 'volume_create_manager' (dc2052ad-d176-4512-b50f-d305e9bae9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d3e2f9-9191-4b21-9c9d-d96bb560ec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:30 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 Sep 16 16:13:30 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d3e2f9-9191-4b21-9c9d-d96bb560ec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1649998491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03cd8c5-db7a-42c8-b010-2bd71021aa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3122a85bf0b409d94e1dd4fa2c7b3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:30Z,use_quota=True,user_id='4c36f6c382af40c5a813c8d69dd94a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3f4028-b5be-4f0a-8274-753aa1c27149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3f4028-b5be-4f0a-8274-753aa1c27149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06956a60-6fb6-4a9a-988e-b17337579a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06956a60-6fb6-4a9a-988e-b17337579a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03cd8c5-db7a-42c8-b010-2bd71021aa86', 'volume_name': 'volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdee6f99-2086-4072-95de-896e1c471e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdee6f99-2086-4072-95de-896e1c471e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8d8ae4-ad2e-459f-aec2-f384a76368b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:30 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Volume a03cd8c5-db7a-42c8-b010-2bd71021aa86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86', 'volume_size': 1} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:30 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086" returned: 0 in 0.534s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabb765b-dee0-4328-869f-452bf5769f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:30 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab 1G Sep 16 16:13:30 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:30 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab 1G" returned: 0 in 0.625s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:30 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab Sep 16 16:13:31 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:31 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab" returned: 0 in 0.417s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:31 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab is being set with open permissions: ugo+rw Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:31 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab Sep 16 16:13:31 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:31 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab" returned: 0 in 0.353s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=63,cinder:UPDATE=66,cinder:DELETE=7,cinder:INSERT=13 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1649998491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03cd8c5-db7a-42c8-b010-2bd71021aa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3122a85bf0b409d94e1dd4fa2c7b3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:13:30Z,use_quota=True,user_id='4c36f6c382af40c5a813c8d69dd94a26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Creating volume a03cd8c5-db7a-42c8-b010-2bd71021aa86 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:13:31 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:31 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=64,cinder:SELECT=59,cinder:INSERT=16,cinder:DELETE=7 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:13:31 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 1073741824 Sep 16 16:13:31 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-60d14292-95bb-4616-a752-e27be24d448f tempest-VolumesSnapshotListTestJSON-260595977 None] Create snapshot completed successfully Sep 16 16:13:32 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 1073741824" returned: 0 in 0.704s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:32 devstack sudo[92283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 Sep 16 16:13:32 devstack sudo[92283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:33 devstack sudo[92283]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86" returned: 0 in 0.499s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8d8ae4-ad2e-459f-aec2-f384a76368b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec089619-2193-4ea0-92bb-3e10dbdd9c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:13:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Volume volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 (a03cd8c5-db7a-42c8-b010-2bd71021aa86): created successfully Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec089619-2193-4ea0-92bb-3e10dbdd9c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Flow 'volume_create_manager' (dc2052ad-d176-4512-b50f-d305e9bae9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:13:33 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f610c613-e40c-4d8a-ba36-86b0793e498d tempest-AttachVolumeNegativeTest-1290048330 None] Created volume successfully. Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-7f1b49df-2a23-4857-903c-aeee81af83ab-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-7f1b49df-2a23-4857-903c-aeee81af83ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-quobyte-7f1b49df-2a23-4857-903c-aeee81af83ab" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-7f1b49df-2a23-4857-903c-aeee81af83ab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Deleting offline snapshot 7f1b49df-2a23-4857-903c-aeee81af83ab of volume dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] snapshot_file for this snap is: volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e214b1db-d58a-4d30-9990-cf1daf355261]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:34 devstack sudo[92292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab Sep 16 16:13:34 devstack sudo[92292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:34 devstack sudo[92292]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab" returned: 0 in 0.440s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabb765b-dee0-4328-869f-452bf5769f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:13:34 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f004fab-b26a-428d-b9b4-f54c04726064]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:34 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 Sep 16 16:13:34 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:35 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086" returned: 0 in 0.563s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabb765b-dee0-4328-869f-452bf5769f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:13:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:35 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab Sep 16 16:13:35 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-3e290b68-c69e-4649-a411-511f6381dd38 req-28615735-0d9f-406a-9e21-7c5e287d9122 tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-3e290b68-c69e-4649-a411-511f6381dd38 req-28615735-0d9f-406a-9e21-7c5e287d9122 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-3e290b68-c69e-4649-a411-511f6381dd38 req-28615735-0d9f-406a-9e21-7c5e287d9122 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-3e290b68-c69e-4649-a411-511f6381dd38 req-28615735-0d9f-406a-9e21-7c5e287d9122 tempest-AttachVolumeNegativeTest-1290048330 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbcfe0af-6c2f-41be-b500-72a4e70290ca', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:13:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-3e290b68-c69e-4649-a411-511f6381dd38 req-28615735-0d9f-406a-9e21-7c5e287d9122 tempest-AttachVolumeNegativeTest-1290048330 None] attachment_update completed successfully. Sep 16 16:13:35 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab" returned: 0 in 0.854s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:35 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab Sep 16 16:13:35 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:36 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.7f1b49df-2a23-4857-903c-aeee81af83ab" returned: 0 in 0.509s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-7f1b49df-2a23-4857-903c-aeee81af83ab" released by "_delete_snapshot" :: held 2.548s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" released by "delete_snapshot" :: held 2.596s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:36 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Created reservations ['dbd5e28f-b2d9-439a-a99c-bff90b710192', '1b0bae87-6cb8-4c5d-b85d-5997462fef2d', 'b57ddac6-8180-4b0f-adb3-01f6326bb6e6', 'e9908999-c0db-407c-9fde-41d16b374620'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Delete snapshot completed successfully. Sep 16 16:13:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c338c458-99fa-4a18-a353-7dd307ef5c5e tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-7f1b49df-2a23-4857-903c-aeee81af83ab-delete_snapshot" released by "delete_snapshot" :: held 2.989s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-f960a1fb-4cad-4104-9c25-71ebaec07086-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-f960a1fb-4cad-4104-9c25-71ebaec07086-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-quobyte-f960a1fb-4cad-4104-9c25-71ebaec07086" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-f960a1fb-4cad-4104-9c25-71ebaec07086" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Deleting offline snapshot f960a1fb-4cad-4104-9c25-71ebaec07086 of volume dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] snapshot_file for this snap is: volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[df689c70-f0e7-4a3d-a535-8c7ed38410cf]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:37 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 Sep 16 16:13:37 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:37 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086" returned: 0 in 0.484s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabb765b-dee0-4328-869f-452bf5769f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc573739-db92-4b05-b74d-f9cecc85a78f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:37 devstack sudo[92812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 Sep 16 16:13:37 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:38 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4" returned: 0 in 0.503s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabb765b-dee0-4328-869f-452bf5769f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:13:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:38 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 Sep 16 16:13:38 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-8870b06a-1bd1-4e77-bfcd-fe207aafa679 req-b3f5a77b-b03f-431a-aaed-a7704a4f3418 tempest-AttachVolumeNegativeTest-1290048330 None] Terminate volume connection completed successfully. Sep 16 16:13:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-8870b06a-1bd1-4e77-bfcd-fe207aafa679 req-b3f5a77b-b03f-431a-aaed-a7704a4f3418 tempest-AttachVolumeNegativeTest-1290048330 None] Deleting attachment bbcfe0af-6c2f-41be-b500-72a4e70290ca. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:13:38 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086" returned: 0 in 0.635s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:38 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086 Sep 16 16:13:38 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:39 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.f960a1fb-4cad-4104-9c25-71ebaec07086" returned: 0 in 0.630s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-f960a1fb-4cad-4104-9c25-71ebaec07086" released by "_delete_snapshot" :: held 2.467s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" released by "delete_snapshot" :: held 2.505s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:39 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Created reservations ['45688f9f-f91d-413d-a61b-21a4644a2599', 'fd5431bd-6053-4bf9-9cfa-f9e683e9ccf7', 'bd4ae5a7-92ea-44ee-9f20-605af873b631', '076c512d-3762-4a5a-b3be-9577215593db'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Delete snapshot completed successfully. Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-73015593-a11a-4281-97f1-5ab7b7c464d5 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-f960a1fb-4cad-4104-9c25-71ebaec07086-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-429a8af2-0f98-4b36-82f5-159962d986e4-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-429a8af2-0f98-4b36-82f5-159962d986e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-quobyte-429a8af2-0f98-4b36-82f5-159962d986e4" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-429a8af2-0f98-4b36-82f5-159962d986e4" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Deleting offline snapshot 429a8af2-0f98-4b36-82f5-159962d986e4 of volume dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] snapshot_file for this snap is: volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[45170f82-232f-4c13-bc07-d8687cecb657]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:41 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 Sep 16 16:13:41 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:41 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4" returned: 0 in 0.802s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabb765b-dee0-4328-869f-452bf5769f1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:13:41 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:13:41 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6daf2e5-0e77-453f-859d-6d250a42373d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:42 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e Sep 16 16:13:42 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:42 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.952s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:13:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:13:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:13:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:13:43 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e" returned: 0 in 1.226s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:43 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 Sep 16 16:13:43 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:43 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4" returned: 0 in 0.771s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:43 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4 Sep 16 16:13:43 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:44 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e.429a8af2-0f98-4b36-82f5-159962d986e4" returned: 0 in 0.355s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-429a8af2-0f98-4b36-82f5-159962d986e4" released by "_delete_snapshot" :: held 3.481s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" released by "delete_snapshot" :: held 3.535s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:44 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Created reservations ['5e63ddc1-591a-4678-8312-b08015994307', '55185841-cfea-42f3-8585-e14b33c6deb7', '67dda25f-bbf1-4026-8b95-4ddfd4c30985', '1b5f02ae-239a-4f54-b972-a12de4608004'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Delete snapshot completed successfully. Sep 16 16:13:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e154be14-ba3e-4e88-9f00-fd26928cb284 tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-429a8af2-0f98-4b36-82f5-159962d986e4-delete_snapshot" released by "delete_snapshot" :: held 3.798s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-920c90f5-eabc-4bb5-8526-3f7ce1556bea req-7d3d3bd3-dd2c-4e2d-bfb1-9ed1036b5d03 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-920c90f5-eabc-4bb5-8526-3f7ce1556bea req-7d3d3bd3-dd2c-4e2d-bfb1-9ed1036b5d03 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-920c90f5-eabc-4bb5-8526-3f7ce1556bea req-7d3d3bd3-dd2c-4e2d-bfb1-9ed1036b5d03 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-920c90f5-eabc-4bb5-8526-3f7ce1556bea req-7d3d3bd3-dd2c-4e2d-bfb1-9ed1036b5d03 tempest-ServerActionsTestOtherA-2099364010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6e5a5f0-d9dc-43b6-b5a2-856144e7c2fc', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:13:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-920c90f5-eabc-4bb5-8526-3f7ce1556bea req-7d3d3bd3-dd2c-4e2d-bfb1-9ed1036b5d03 tempest-ServerActionsTestOtherA-2099364010 None] attachment_update completed successfully. Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-dabb765b-dee0-4328-869f-452bf5769f1e-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-dabb765b-dee0-4328-869f-452bf5769f1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c876460-895e-48ad-9fde-229ceb6363cb]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:45 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e Sep 16 16:13:45 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "cinder-a03cd8c5-db7a-42c8-b010-2bd71021aa86-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-a03cd8c5-db7a-42c8-b010-2bd71021aa86-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "cinder-quobyte-a03cd8c5-db7a-42c8-b010-2bd71021aa86" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-quobyte-a03cd8c5-db7a-42c8-b010-2bd71021aa86" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c0270-096a-41d3-9e25-0b1dcee987cf]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:46 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e" returned: 0 in 0.730s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:46 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 Sep 16 16:13:46 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:46 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e Sep 16 16:13:46 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:46 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dabb765b-dee0-4328-869f-452bf5769f1e" returned: 0 in 0.362s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:46 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-quobyte-dabb765b-dee0-4328-869f-452bf5769f1e" released by "delete_volume" :: held 1.186s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86" returned: 0 in 0.573s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:46 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86 Sep 16 16:13:46 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Created reservations ['a3875ea1-bf5c-47cb-9437-b92e51ec222e', 'f9ffc39e-9849-4a02-a583-fc833630e0f8', '91028b06-290c-4481-b8b3-7d706abe07d1', 'a245eb22-214d-4035-80ae-4fdd5fddfa0d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:46 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:13:46 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:46 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a03cd8c5-db7a-42c8-b010-2bd71021aa86" returned: 0 in 0.338s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-quobyte-a03cd8c5-db7a-42c8-b010-2bd71021aa86" released by "delete_volume" :: held 0.986s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Created reservations ['e2942581-d38e-405f-8a6e-086d5dd002e6', 'e0bfc267-aa4c-4a83-aafa-40dd0c2456c9', '85af75e1-11e8-49d3-b000-6f1d5e578c32', 'e057f11d-7a15-458e-a86f-18c991c0fefc'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:46 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.378s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:46 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Deleted volume successfully. Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5583e723-8750-407e-bb92-a13f0f92337a tempest-VolumesSnapshotListTestJSON-260595977 None] Lock "cinder-dabb765b-dee0-4328-869f-452bf5769f1e-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:47 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:13:47 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:47 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.281s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:13:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Deleted volume successfully. Sep 16 16:13:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-56eeed21-c88f-4ee3-b3cc-8589549eb88e tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-a03cd8c5-db7a-42c8-b010-2bd71021aa86-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "cinder-223c983b-ac6b-495a-8bfc-4dc74fc06df3-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-223c983b-ac6b-495a-8bfc-4dc74fc06df3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "cinder-quobyte-223c983b-ac6b-495a-8bfc-4dc74fc06df3" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-quobyte-223c983b-ac6b-495a-8bfc-4dc74fc06df3" acquired by "delete_volume" :: waited 0.035s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:48 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee58173-cb7e-4a0a-b56e-f3da6b964cc8]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:48 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 Sep 16 16:13:48 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:48 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3" returned: 0 in 0.570s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:48 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3 Sep 16 16:13:48 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-d211904d-fac4-44c8-a63a-faf09a4f0a72 req-efaaf911-cd58-47d9-942c-245bc4dec247 tempest-ServerActionsTestOtherA-2099364010 None] Terminate volume connection completed successfully. Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-d211904d-fac4-44c8-a63a-faf09a4f0a72 req-efaaf911-cd58-47d9-942c-245bc4dec247 tempest-ServerActionsTestOtherA-2099364010 None] Deleting attachment d6e5a5f0-d9dc-43b6-b5a2-856144e7c2fc. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223c983b-ac6b-495a-8bfc-4dc74fc06df3" returned: 0 in 0.529s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:49 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-quobyte-223c983b-ac6b-495a-8bfc-4dc74fc06df3" released by "delete_volume" :: held 1.198s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Created reservations ['cc5d2e9e-0b8c-4124-a16b-3064b41c2aa9', 'ab0a2f47-a0c3-45ac-9c8f-e63c56aba657', 'a3e64b20-9dd3-4de8-b2de-fe5cf7fb9d5a', '90f62e14-17f3-4dc3-94fc-05e2384a0c27'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:49 devstack sudo[93450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:13:49 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:50 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.476s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:50 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:13:50 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Deleted volume successfully. Sep 16 16:13:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-272d4fe3-3c07-44e1-a884-ae74cf44438a tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-223c983b-ac6b-495a-8bfc-4dc74fc06df3-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-d211904d-fac4-44c8-a63a-faf09a4f0a72 req-cc60777c-4e0c-42cf-8ec9-606121cefc4c tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-d211904d-fac4-44c8-a63a-faf09a4f0a72 req-cc60777c-4e0c-42cf-8ec9-606121cefc4c tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-d211904d-fac4-44c8-a63a-faf09a4f0a72 req-cc60777c-4e0c-42cf-8ec9-606121cefc4c tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-d211904d-fac4-44c8-a63a-faf09a4f0a72 req-cc60777c-4e0c-42cf-8ec9-606121cefc4c tempest-ServerActionsTestOtherA-2099364010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f380ede-f833-4321-acbc-03b87ba7e0ce', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:13:50 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-d211904d-fac4-44c8-a63a-faf09a4f0a72 req-cc60777c-4e0c-42cf-8ec9-606121cefc4c tempest-ServerActionsTestOtherA-2099364010 None] attachment_update completed successfully. Sep 16 16:13:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "cinder-553a59c7-e63f-43c9-b362-68be89dcc36e-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-553a59c7-e63f-43c9-b362-68be89dcc36e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "cinder-quobyte-553a59c7-e63f-43c9-b362-68be89dcc36e" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-quobyte-553a59c7-e63f-43c9-b362-68be89dcc36e" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ecb5a6-f42e-46a8-bfcc-2ae2ef66ec89]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:51 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e Sep 16 16:13:51 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:51 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e" returned: 0 in 0.441s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:51 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e Sep 16 16:13:51 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:51 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-553a59c7-e63f-43c9-b362-68be89dcc36e" returned: 0 in 0.281s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-quobyte-553a59c7-e63f-43c9-b362-68be89dcc36e" released by "delete_volume" :: held 0.785s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:13:51 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Created reservations ['cab57b6d-eb10-4b28-a122-369af8118bc7', 'd130398e-dbd2-4597-ae95-cfeb20121418', 'aa3a1377-f6a4-41f8-b408-4f1952c78041', '09901cbc-e080-4905-8daa-9c933595a905'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:13:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:13:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:13:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:13:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:13:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:13:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:13:52 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:13:52 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:13:52 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 16 16:13:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.491s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:13:52 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:13:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Deleted volume successfully. Sep 16 16:13:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-81659216-5223-443c-9153-fce3181c6a59 tempest-AttachVolumeNegativeTest-1290048330 None] Lock "cinder-553a59c7-e63f-43c9-b362-68be89dcc36e-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:02 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:INSERT=17,cinder:UPDATE=63,cinder:SELECT=58,cinder:DELETE=1 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:14:02 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=50,cinder:DELETE=5,cinder:SELECT=57,cinder:INSERT=12 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Flow 'volume_create_manager' (defd904f-b0ad-43ab-9113-23c5ef3c7eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fad14ea-4811-407b-aedf-f2e5f993c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fad14ea-4811-407b-aedf-f2e5f993c32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1055498751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a2d736-a4bf-40ef-88e1-603bd165e476,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f9cbb087ac6b458395891d294aba7791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:03Z,use_quota=True,user_id='70ea5ab45ee84337a15aa0a5f536869e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397d6901-a5ca-4bd6-a442-409de50fd71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397d6901-a5ca-4bd6-a442-409de50fd71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985f2c2a-f781-4130-a9b6-028d1e2c80de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (985f2c2a-f781-4130-a9b6-028d1e2c80de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a2d736-a4bf-40ef-88e1-603bd165e476', 'volume_name': 'volume-82a2d736-a4bf-40ef-88e1-603bd165e476', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2159a8c7-6e3c-4a9c-853c-fc03f5cd9185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2159a8c7-6e3c-4a9c-853c-fc03f5cd9185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb8666e-7f00-4244-ba2b-956fd9894453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Volume 82a2d736-a4bf-40ef-88e1-603bd165e476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a2d736-a4bf-40ef-88e1-603bd165e476', 'volume_size': 1} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1055498751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a2d736-a4bf-40ef-88e1-603bd165e476,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f9cbb087ac6b458395891d294aba7791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:03Z,use_quota=True,user_id='70ea5ab45ee84337a15aa0a5f536869e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Creating volume 82a2d736-a4bf-40ef-88e1-603bd165e476 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:03 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:03 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476 1073741824 Sep 16 16:14:03 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Flow 'volume_create_manager' (968ab592-02cb-421e-9e47-7c3ebed36678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6420ded9-dbb9-4524-b31d-68c621d1d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6420ded9-dbb9-4524-b31d-68c621d1d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2064479405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358dcb32-e164-44ca-bc99-9dd00b8973c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4161a5debc41cd9402ca64c255d176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:04Z,use_quota=True,user_id='bfaf69c27d8d4f7199abe1f23a9c4241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e8a162-722b-4f1a-ab5c-66f787f0b16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e8a162-722b-4f1a-ab5c-66f787f0b16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4152e7-4c76-4752-a7e9-6b4eb8adec49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4152e7-4c76-4752-a7e9-6b4eb8adec49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '358dcb32-e164-44ca-bc99-9dd00b8973c0', 'volume_name': 'volume-358dcb32-e164-44ca-bc99-9dd00b8973c0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5390a113-ea36-4d70-96bc-10a6ae172030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5390a113-ea36-4d70-96bc-10a6ae172030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8a7c1d-69a6-4f23-a473-9b7ec2a2ff93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:03 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Volume 358dcb32-e164-44ca-bc99-9dd00b8973c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-358dcb32-e164-44ca-bc99-9dd00b8973c0', 'volume_size': 1} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:03 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476 1073741824" returned: 0 in 0.568s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:03 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476 Sep 16 16:14:03 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:04 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476" returned: 0 in 0.411s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2064479405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=358dcb32-e164-44ca-bc99-9dd00b8973c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4161a5debc41cd9402ca64c255d176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:04Z,use_quota=True,user_id='bfaf69c27d8d4f7199abe1f23a9c4241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Creating volume 358dcb32-e164-44ca-bc99-9dd00b8973c0 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:04 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:04 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 1073741824 Sep 16 16:14:04 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb8666e-7f00-4244-ba2b-956fd9894453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a2d736-a4bf-40ef-88e1-603bd165e476', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca9d1db-5c62-40a4-941c-653944f88c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:04 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Volume volume-82a2d736-a4bf-40ef-88e1-603bd165e476 (82a2d736-a4bf-40ef-88e1-603bd165e476): created successfully Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca9d1db-5c62-40a4-941c-653944f88c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Flow 'volume_create_manager' (defd904f-b0ad-43ab-9113-23c5ef3c7eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:04 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c3fdbbf6-3343-4ed8-b49e-a24fd0601bd4 tempest-VolumesTestJSON-1233270227 None] Created volume successfully. Sep 16 16:14:04 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 1073741824" returned: 0 in 0.602s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:05 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 Sep 16 16:14:05 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:05 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0" returned: 0 in 0.358s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8a7c1d-69a6-4f23-a473-9b7ec2a2ff93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-358dcb32-e164-44ca-bc99-9dd00b8973c0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2149b403-46b0-4fec-8394-c62f9f2bfead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:05 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Volume volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 (358dcb32-e164-44ca-bc99-9dd00b8973c0): created successfully Sep 16 16:14:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2149b403-46b0-4fec-8394-c62f9f2bfead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Flow 'volume_create_manager' (968ab592-02cb-421e-9e47-7c3ebed36678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9c26dd8b-ba3a-4ae4-9017-c88b6a466f19 tempest-AttachVolumeTestJSON-933576402 None] Created volume successfully. Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Flow 'volume_create_manager' (c2107c30-22e3-459d-8896-5e260b1d6bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2f2ae0-3945-451d-bbf1-062832b89750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2f2ae0-3945-451d-bbf1-062832b89750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-827998167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d56520d-d5ea-46ac-925a-35cc1ebffe2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f9cbb087ac6b458395891d294aba7791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:06Z,use_quota=True,user_id='70ea5ab45ee84337a15aa0a5f536869e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f123261-ee4e-4b7f-9e57-0aac1c54af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f123261-ee4e-4b7f-9e57-0aac1c54af06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ebf24d-cdd4-421b-a979-da1c264b0c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ebf24d-cdd4-421b-a979-da1c264b0c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d56520d-d5ea-46ac-925a-35cc1ebffe2a', 'volume_name': 'volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873352ae-64b1-439d-9559-8b370ae81cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873352ae-64b1-439d-9559-8b370ae81cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d35c97c-7a3e-4bd4-8a46-590a4b7317e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Volume 9d56520d-d5ea-46ac-925a-35cc1ebffe2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a', 'volume_size': 1} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-827998167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d56520d-d5ea-46ac-925a-35cc1ebffe2a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f9cbb087ac6b458395891d294aba7791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:06Z,use_quota=True,user_id='70ea5ab45ee84337a15aa0a5f536869e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Creating volume 9d56520d-d5ea-46ac-925a-35cc1ebffe2a {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:06 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:06 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a 1073741824 Sep 16 16:14:06 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-c23a5921-0b70-44cf-9c60-9ed6d62fdbd2 req-045950fa-7870-4eb4-9464-36c7d87f8125 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:07 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a 1073741824" returned: 0 in 0.723s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:07 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a Sep 16 16:14:07 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:07 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a" returned: 0 in 0.311s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-c23a5921-0b70-44cf-9c60-9ed6d62fdbd2 req-045950fa-7870-4eb4-9464-36c7d87f8125 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.446s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-c23a5921-0b70-44cf-9c60-9ed6d62fdbd2 req-045950fa-7870-4eb4-9464-36c7d87f8125 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d35c97c-7a3e-4bd4-8a46-590a4b7317e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441cc2e7-fea3-4524-bb13-0578a9df45ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:07 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Volume volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a (9d56520d-d5ea-46ac-925a-35cc1ebffe2a): created successfully Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441cc2e7-fea3-4524-bb13-0578a9df45ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Flow 'volume_create_manager' (c2107c30-22e3-459d-8896-5e260b1d6bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9b50c59a-4334-4e88-b62e-777ec98c05bb tempest-VolumesTestJSON-1233270227 None] Created volume successfully. Sep 16 16:14:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-c23a5921-0b70-44cf-9c60-9ed6d62fdbd2 req-045950fa-7870-4eb4-9464-36c7d87f8125 tempest-AttachVolumeTestJSON-933576402 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-358dcb32-e164-44ca-bc99-9dd00b8973c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5a40fe2-ed2f-40c0-9a15-d439b33997d2', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:14:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-c23a5921-0b70-44cf-9c60-9ed6d62fdbd2 req-045950fa-7870-4eb4-9464-36c7d87f8125 tempest-AttachVolumeTestJSON-933576402 None] attachment_update completed successfully. Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Flow 'volume_create_manager' (1836aa82-50e4-4e9e-977e-77a2fc2a1020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9c9ca6-d464-4321-9284-ceab4595b5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9c9ca6-d464-4321-9284-ceab4595b5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-700133654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29d3301-a416-4d36-8e13-3664eeed702e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f9cbb087ac6b458395891d294aba7791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:09Z,use_quota=True,user_id='70ea5ab45ee84337a15aa0a5f536869e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada3768d-11a9-48b2-8ce6-a39981b9f876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada3768d-11a9-48b2-8ce6-a39981b9f876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d5f46b-078c-4ef8-8b74-14364603c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d5f46b-078c-4ef8-8b74-14364603c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29d3301-a416-4d36-8e13-3664eeed702e', 'volume_name': 'volume-b29d3301-a416-4d36-8e13-3664eeed702e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f261713-6e5a-441f-945b-4c238ce82c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f261713-6e5a-441f-945b-4c238ce82c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e43a09-65c4-4487-b09b-4453bcea371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Volume b29d3301-a416-4d36-8e13-3664eeed702e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29d3301-a416-4d36-8e13-3664eeed702e', 'volume_size': 1} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-700133654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29d3301-a416-4d36-8e13-3664eeed702e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f9cbb087ac6b458395891d294aba7791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:09Z,use_quota=True,user_id='70ea5ab45ee84337a15aa0a5f536869e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Creating volume b29d3301-a416-4d36-8e13-3664eeed702e {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:09 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:09 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e 1073741824 Sep 16 16:14:09 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:09 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e 1073741824" returned: 0 in 0.529s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:09 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e Sep 16 16:14:09 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Flow 'volume_create_manager' (13da2e7e-293c-42ee-a993-7d0f2631d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7589d6-08c6-495b-9a3e-b96655d30b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7589d6-08c6-495b-9a3e-b96655d30b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-775847155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6313f420-51f2-4e4d-932a-08333f23d52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4161a5debc41cd9402ca64c255d176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:10Z,use_quota=True,user_id='bfaf69c27d8d4f7199abe1f23a9c4241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f56ef3-4786-4881-8934-52592f69b2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f56ef3-4786-4881-8934-52592f69b2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1230978e-5336-4306-a220-80aeed8b7014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1230978e-5336-4306-a220-80aeed8b7014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6313f420-51f2-4e4d-932a-08333f23d52e', 'volume_name': 'volume-6313f420-51f2-4e4d-932a-08333f23d52e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e9e4aa-a5fb-43de-bb09-2fb388a38e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e9e4aa-a5fb-43de-bb09-2fb388a38e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d2fdfe-6c23-49cc-a9da-b2b2d4c7cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Volume 6313f420-51f2-4e4d-932a-08333f23d52e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6313f420-51f2-4e4d-932a-08333f23d52e', 'volume_size': 1} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:09 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-775847155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6313f420-51f2-4e4d-932a-08333f23d52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba4161a5debc41cd9402ca64c255d176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:10Z,use_quota=True,user_id='bfaf69c27d8d4f7199abe1f23a9c4241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Creating volume 6313f420-51f2-4e4d-932a-08333f23d52e {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:09 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e43a09-65c4-4487-b09b-4453bcea371b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29d3301-a416-4d36-8e13-3664eeed702e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:10 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e 1073741824 Sep 16 16:14:10 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3458a1-bc11-4d18-8e95-1fa6cc14bf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:10 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Volume volume-b29d3301-a416-4d36-8e13-3664eeed702e (b29d3301-a416-4d36-8e13-3664eeed702e): created successfully Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3458a1-bc11-4d18-8e95-1fa6cc14bf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Flow 'volume_create_manager' (1836aa82-50e4-4e9e-977e-77a2fc2a1020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:10 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0232a487-2025-4e8a-91ce-2916385ca66f tempest-VolumesTestJSON-1233270227 None] Created volume successfully. Sep 16 16:14:10 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e 1073741824" returned: 0 in 0.454s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:10 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e Sep 16 16:14:10 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:10 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e" returned: 0 in 0.299s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d2fdfe-6c23-49cc-a9da-b2b2d4c7cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6313f420-51f2-4e4d-932a-08333f23d52e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce078de0-3fd3-43dd-afbb-ae4142154a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:10 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Volume volume-6313f420-51f2-4e4d-932a-08333f23d52e (6313f420-51f2-4e4d-932a-08333f23d52e): created successfully Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce078de0-3fd3-43dd-afbb-ae4142154a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Flow 'volume_create_manager' (13da2e7e-293c-42ee-a993-7d0f2631d68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:10 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2867462d-4166-40d1-81bc-b9e576d50a6e tempest-AttachVolumeTestJSON-933576402 None] Created volume successfully. Sep 16 16:14:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Acquiring lock "cinder-b29d3301-a416-4d36-8e13-3664eeed702e-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Lock "cinder-b29d3301-a416-4d36-8e13-3664eeed702e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Acquiring lock "cinder-quobyte-b29d3301-a416-4d36-8e13-3664eeed702e" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Lock "cinder-quobyte-b29d3301-a416-4d36-8e13-3664eeed702e" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:12 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cd6ebb-acbb-47b6-8c41-6acb44bfba81]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:12 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e Sep 16 16:14:12 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-dee69bc8-b0da-49f7-b833-66ef4b3bfad7 req-8c269eb1-2cd9-43e7-8863-649d243c49cb tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-dee69bc8-b0da-49f7-b833-66ef4b3bfad7 req-8c269eb1-2cd9-43e7-8863-649d243c49cb tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-dee69bc8-b0da-49f7-b833-66ef4b3bfad7 req-8c269eb1-2cd9-43e7-8863-649d243c49cb tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:13 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e" returned: 0 in 0.467s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:13 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-dee69bc8-b0da-49f7-b833-66ef4b3bfad7 req-8c269eb1-2cd9-43e7-8863-649d243c49cb tempest-AttachVolumeTestJSON-933576402 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-6313f420-51f2-4e4d-932a-08333f23d52e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8fe1b77-d446-4eec-bde8-abbf7a96c098', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:14:13 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:13 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-dee69bc8-b0da-49f7-b833-66ef4b3bfad7 req-8c269eb1-2cd9-43e7-8863-649d243c49cb tempest-AttachVolumeTestJSON-933576402 None] attachment_update completed successfully. Sep 16 16:14:13 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b29d3301-a416-4d36-8e13-3664eeed702e" returned: 0 in 0.313s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Lock "cinder-quobyte-b29d3301-a416-4d36-8e13-3664eeed702e" released by "delete_volume" :: held 0.856s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Created reservations ['f5781e08-efdc-4d9a-9261-a5bdb422a255', 'd5d4e02c-56fa-4e65-8bf9-bba5fa4cff2e', 'b4bc072a-b524-4a21-92c8-c56d1f0c92ac', '79f7a282-ccf4-4922-911d-9d709b7b1275'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:13 devstack sudo[94116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:14:13 devstack sudo[94116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Acquiring lock "cinder-9d56520d-d5ea-46ac-925a-35cc1ebffe2a-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Lock "cinder-9d56520d-d5ea-46ac-925a-35cc1ebffe2a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Acquiring lock "cinder-quobyte-9d56520d-d5ea-46ac-925a-35cc1ebffe2a" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Lock "cinder-quobyte-9d56520d-d5ea-46ac-925a-35cc1ebffe2a" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5407abd-78ba-44f7-aaa7-1210b80554be]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:14 devstack sudo[94116]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.473s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:14 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:14:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Deleted volume successfully. Sep 16 16:14:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-43e695b5-d32e-4674-8767-74418614b297 tempest-VolumesTestJSON-1233270227 None] Lock "cinder-b29d3301-a416-4d36-8e13-3664eeed702e-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:14 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a Sep 16 16:14:14 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:14 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a" returned: 0 in 0.622s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:14 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a Sep 16 16:14:14 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:15 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9d56520d-d5ea-46ac-925a-35cc1ebffe2a" returned: 0 in 0.461s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Lock "cinder-quobyte-9d56520d-d5ea-46ac-925a-35cc1ebffe2a" released by "delete_volume" :: held 1.191s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:15 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Created reservations ['ff085098-315d-4634-8bf4-ddba75e1d0ad', '5dbb4542-959b-4c14-8751-97fdbae08277', '297be751-315f-465f-bed3-b8684f9961c8', '804601d5-d31e-47e1-9004-d07ab53afe08'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:14:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:15 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:14:15 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Acquiring lock "cinder-82a2d736-a4bf-40ef-88e1-603bd165e476-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Lock "cinder-82a2d736-a4bf-40ef-88e1-603bd165e476-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:16 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Acquiring lock "cinder-quobyte-82a2d736-a4bf-40ef-88e1-603bd165e476" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.596s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:14:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Deleted volume successfully. Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Lock "cinder-quobyte-82a2d736-a4bf-40ef-88e1-603bd165e476" acquired by "delete_volume" :: waited 0.044s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de26f8-e590-44f9-a953-5a3ee0aa49b4]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59652c29-4373-4cf6-8f34-14298fb16bfb tempest-VolumesTestJSON-1233270227 None] Lock "cinder-9d56520d-d5ea-46ac-925a-35cc1ebffe2a-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:16 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476 Sep 16 16:14:16 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-c2db7957-2e01-4acd-84f8-bfbb9d0d3e42 req-17d4df5e-631c-4553-bf63-3b78b8fc8ade tempest-AttachVolumeTestJSON-933576402 None] Terminate volume connection completed successfully. Sep 16 16:14:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-c2db7957-2e01-4acd-84f8-bfbb9d0d3e42 req-17d4df5e-631c-4553-bf63-3b78b8fc8ade tempest-AttachVolumeTestJSON-933576402 None] Deleting attachment d5a40fe2-ed2f-40c0-9a15-d439b33997d2. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:14:17 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476" returned: 0 in 0.760s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:17 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476 Sep 16 16:14:17 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:17 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-82a2d736-a4bf-40ef-88e1-603bd165e476" returned: 0 in 0.301s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Lock "cinder-quobyte-82a2d736-a4bf-40ef-88e1-603bd165e476" released by "delete_volume" :: held 1.184s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Created reservations ['a98517da-5df4-457e-8682-665e6cc8cebd', '09e5cc9b-e2a9-4ab5-b115-76bd16ee8c31', '6e622e65-15d1-4e02-9aa9-0c341c2726cd', 'c85a12d6-d119-451e-a1d9-9ba03b11a9e2'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:17 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:14:17 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-4a14fe0b-33ae-45c1-b902-5cf82bd3ce3b req-270b1c08-c721-40e5-91b6-5f6a9c1387d8 tempest-AttachVolumeTestJSON-933576402 None] Terminate volume connection completed successfully. Sep 16 16:14:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-4a14fe0b-33ae-45c1-b902-5cf82bd3ce3b req-270b1c08-c721-40e5-91b6-5f6a9c1387d8 tempest-AttachVolumeTestJSON-933576402 None] Deleting attachment c8fe1b77-d446-4eec-bde8-abbf7a96c098. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:14:18 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.318s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:18 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:14:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Deleted volume successfully. Sep 16 16:14:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6c93314-965c-4253-8da1-caed8e1a4ba0 tempest-VolumesTestJSON-1233270227 None] Lock "cinder-82a2d736-a4bf-40ef-88e1-603bd165e476-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:20 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-b0a82cf3-48c3-4b1c-817c-3e0ca4fb7c53 req-d420f006-1104-4469-8fe7-ca94da232fd8 tempest-ServerActionsTestOtherA-2099364010 None] Terminate volume connection completed successfully. Sep 16 16:14:20 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-b0a82cf3-48c3-4b1c-817c-3e0ca4fb7c53 req-d420f006-1104-4469-8fe7-ca94da232fd8 tempest-ServerActionsTestOtherA-2099364010 None] Deleting attachment 3f380ede-f833-4321-acbc-03b87ba7e0ce. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:14:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "cinder-6313f420-51f2-4e4d-932a-08333f23d52e-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-6313f420-51f2-4e4d-932a-08333f23d52e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "cinder-quobyte-6313f420-51f2-4e4d-932a-08333f23d52e" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-quobyte-6313f420-51f2-4e4d-932a-08333f23d52e" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:25 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f248c81c-3dda-4d96-8822-1158707bdfc5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:25 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e Sep 16 16:14:25 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:25 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e" returned: 0 in 0.498s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:25 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e Sep 16 16:14:25 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:26 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6313f420-51f2-4e4d-932a-08333f23d52e" returned: 0 in 0.324s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-quobyte-6313f420-51f2-4e4d-932a-08333f23d52e" released by "delete_volume" :: held 0.891s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Created reservations ['5c10d3f3-24fc-4578-a648-0cee642ff37d', 'fb5c7d90-315e-43ff-9fc5-d4b889ea074c', '02aed47d-192b-4e2f-ad4d-439e8187aa65', '5d26d0d7-a4e7-4b43-8a1f-d6047b5826e5'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:26 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:14:26 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "cinder-358dcb32-e164-44ca-bc99-9dd00b8973c0-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-358dcb32-e164-44ca-bc99-9dd00b8973c0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "cinder-quobyte-358dcb32-e164-44ca-bc99-9dd00b8973c0" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-quobyte-358dcb32-e164-44ca-bc99-9dd00b8973c0" acquired by "delete_volume" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced7ca60-e745-4a3a-a9eb-d6e606f21148]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:26 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 Sep 16 16:14:26 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Flow 'volume_create_manager' (75a47a55-ce08-413a-8128-d37da4119e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685678d3-5021-451a-9c5f-4cf4a72e76dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685678d3-5021-451a-9c5f-4cf4a72e76dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-974008281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca7f845-9f09-4c62-ba6b-85da93465841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e9d4629226f4b32a4059906a56b4fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:27Z,use_quota=True,user_id='989ff795f905417689acb041d4245098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a37b02f6-bf7b-4b78-bcfd-ba8e608d7fba),volume_type_id=a37b02f6-bf7b-4b78-bcfd-ba8e608d7fba)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fd64e0-1ac0-4220-8722-9343d4e760aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fd64e0-1ac0-4220-8722-9343d4e760aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d663171c-a3ca-48df-b281-066f5e00ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d663171c-a3ca-48df-b281-066f5e00ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca7f845-9f09-4c62-ba6b-85da93465841', 'volume_name': 'volume-5ca7f845-9f09-4c62-ba6b-85da93465841', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:27 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e454ab-a613-41d4-8d1e-49246c6509a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e454ab-a613-41d4-8d1e-49246c6509a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfff316-c80f-4d1c-a77e-6157b1386b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Volume 5ca7f845-9f09-4c62-ba6b-85da93465841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca7f845-9f09-4c62-ba6b-85da93465841', 'volume_size': 1} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-974008281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca7f845-9f09-4c62-ba6b-85da93465841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e9d4629226f4b32a4059906a56b4fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:27Z,use_quota=True,user_id='989ff795f905417689acb041d4245098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a37b02f6-bf7b-4b78-bcfd-ba8e608d7fba),volume_type_id=a37b02f6-bf7b-4b78-bcfd-ba8e608d7fba)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Creating volume 5ca7f845-9f09-4c62-ba6b-85da93465841 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:27 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.673s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:14:27 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Deleted volume successfully. Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-604c1a4b-a39d-4c68-a18e-e4fdf7a7ac76 tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-6313f420-51f2-4e4d-932a-08333f23d52e-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:27 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841 1073741824 Sep 16 16:14:27 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:27 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0" returned: 0 in 0.596s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:27 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0 Sep 16 16:14:27 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Flow 'volume_create_manager' (3fc8fa8d-b311-413c-912c-cc5499de7f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d1d7fc-80ee-4db9-b530-b22414959b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d1d7fc-80ee-4db9-b530-b22414959b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1299277057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28296468-2268-4f22-b5b2-3513efb9b14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e9d4629226f4b32a4059906a56b4fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:28Z,use_quota=True,user_id='989ff795f905417689acb041d4245098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eeba9dd-f855-4537-a4e2-624a12d63303),volume_type_id=0eeba9dd-f855-4537-a4e2-624a12d63303)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e00b41-5a20-4002-ae95-a9f6f64997da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e00b41-5a20-4002-ae95-a9f6f64997da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1fbed5-3af1-4413-b54b-179a0c010a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1fbed5-3af1-4413-b54b-179a0c010a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28296468-2268-4f22-b5b2-3513efb9b14e', 'volume_name': 'volume-28296468-2268-4f22-b5b2-3513efb9b14e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95cd784-9b16-41e5-8c11-e3f50adeab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95cd784-9b16-41e5-8c11-e3f50adeab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c015bb0-6529-49fd-b1e5-3b2a01d49159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:27 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Volume 28296468-2268-4f22-b5b2-3513efb9b14e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28296468-2268-4f22-b5b2-3513efb9b14e', 'volume_size': 1} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:27 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-358dcb32-e164-44ca-bc99-9dd00b8973c0" returned: 0 in 0.556s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-quobyte-358dcb32-e164-44ca-bc99-9dd00b8973c0" released by "delete_volume" :: held 1.246s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:27 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841 1073741824" returned: 0 in 0.865s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:28 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841 Sep 16 16:14:28 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Created reservations ['38aac2c5-869d-4aa8-9dae-c2b09f15dba0', 'f7ca1191-a1c2-4fa4-bcaf-de00d1d2b39f', 'ac505bfc-6454-434f-9784-dc966e610867', 'f020695a-7ade-4c3b-b379-77bf336ed0f4'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:28 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:14:28 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:28 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841" returned: 0 in 0.356s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1299277057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28296468-2268-4f22-b5b2-3513efb9b14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e9d4629226f4b32a4059906a56b4fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:28Z,use_quota=True,user_id='989ff795f905417689acb041d4245098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0eeba9dd-f855-4537-a4e2-624a12d63303),volume_type_id=0eeba9dd-f855-4537-a4e2-624a12d63303)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Creating volume 28296468-2268-4f22-b5b2-3513efb9b14e {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:28 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:28 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e 1073741824 Sep 16 16:14:28 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfff316-c80f-4d1c-a77e-6157b1386b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca7f845-9f09-4c62-ba6b-85da93465841', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31190cdf-243d-4e29-b163-388b466ce426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:28 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Volume volume-5ca7f845-9f09-4c62-ba6b-85da93465841 (5ca7f845-9f09-4c62-ba6b-85da93465841): created successfully Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31190cdf-243d-4e29-b163-388b466ce426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Flow 'volume_create_manager' (75a47a55-ce08-413a-8128-d37da4119e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c5af2c2e-a0f9-49c8-81fc-461651c71327 tempest-TestInstancesWithCinderVolumes-525979578 None] Created volume successfully. Sep 16 16:14:28 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.480s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:14:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Deleted volume successfully. Sep 16 16:14:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-567ecf14-d3c0-4042-b3ad-24f9a98bef71 tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-358dcb32-e164-44ca-bc99-9dd00b8973c0-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:29 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e 1073741824" returned: 0 in 0.703s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:29 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e Sep 16 16:14:29 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Flow 'volume_create_manager' (7187425d-a94d-4483-a1f1-724f8700c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916329b1-df87-410b-bc61-9e78b9d4a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:29 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "cinder-adfb292f-7147-4197-9725-ff897e16d394-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (916329b1-df87-410b-bc61-9e78b9d4a97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-997844807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c939a83e-044d-43e1-aa69-aead43fc4f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e9d4629226f4b32a4059906a56b4fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:29Z,use_quota=True,user_id='989ff795f905417689acb041d4245098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0779d330-6f55-4fa2-a97b-5933e1af25c0),volume_type_id=0779d330-6f55-4fa2-a97b-5933e1af25c0)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72152788-5af3-4c42-ae93-7a576e68fc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72152788-5af3-4c42-ae93-7a576e68fc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff06cf48-dc9f-4bd2-ac88-22eb4b2d2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e" returned: 0 in 0.607s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c015bb0-6529-49fd-b1e5-3b2a01d49159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28296468-2268-4f22-b5b2-3513efb9b14e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3945ff2-8298-47f2-b3f0-7f1d13b8ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-adfb292f-7147-4197-9725-ff897e16d394-delete_volume" acquired by "delete_volume" :: waited 0.162s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:29 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Volume volume-28296468-2268-4f22-b5b2-3513efb9b14e (28296468-2268-4f22-b5b2-3513efb9b14e): created successfully Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3945ff2-8298-47f2-b3f0-7f1d13b8ac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Flow 'volume_create_manager' (3fc8fa8d-b311-413c-912c-cc5499de7f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "cinder-quobyte-adfb292f-7147-4197-9725-ff897e16d394" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-517b618a-e600-45d5-8e7a-88eae92fdd0c tempest-TestInstancesWithCinderVolumes-525979578 None] Created volume successfully. Sep 16 16:14:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-quobyte-adfb292f-7147-4197-9725-ff897e16d394" acquired by "delete_volume" :: waited 0.041s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15cf3be-e179-4113-a192-1d622595cd78]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Flow 'volume_create_manager' (197c54e4-24ee-465a-b171-1d5b17d95529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e88c58e-51e9-4bd3-afae-06e5e3a9b25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e88c58e-51e9-4bd3-afae-06e5e3a9b25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-645032661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220fb968-9789-40d6-bd62-1776898c49fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67bf463e4294ffc908ea75253343c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:30Z,use_quota=True,user_id='305013e6f4e1441da40835126f0bdc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10f5ab3-f9ce-482e-acee-8b670de4a552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10f5ab3-f9ce-482e-acee-8b670de4a552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccfd94e-d32b-4bd3-b67c-a2211e199cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:14:30 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394 Sep 16 16:14:30 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff06cf48-dc9f-4bd2-ac88-22eb4b2d2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c939a83e-044d-43e1-aa69-aead43fc4f4f', 'volume_name': 'volume-c939a83e-044d-43e1-aa69-aead43fc4f4f', 'volume_size': 1, 'image_id': '9916912d-6ab3-406b-b3df-25bf4dda7998', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9916912d-6ab3-406b-b3df-25bf4dda7998', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--159528075', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5e9d4629226f4b32a4059906a56b4fbb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9916912d-6ab3-406b-b3df-25bf4dda7998', 'created_at': datetime.datetime(2026, 9, 16, 14, 14, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9916912d-6ab3-406b-b3df-25bf4dda7998/file', 'properties': {}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed21eca8-d062-46d0-a857-9c70cb608502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed21eca8-d062-46d0-a857-9c70cb608502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e12983-51f4-4829-83c9-cb73c4ce5b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:30 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Volume c939a83e-044d-43e1-aa69-aead43fc4f4f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c939a83e-044d-43e1-aa69-aead43fc4f4f', 'volume_size': 1, 'image_id': '9916912d-6ab3-406b-b3df-25bf4dda7998', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9916912d-6ab3-406b-b3df-25bf4dda7998', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--159528075', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5e9d4629226f4b32a4059906a56b4fbb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9916912d-6ab3-406b-b3df-25bf4dda7998', 'created_at': datetime.datetime(2026, 9, 16, 14, 14, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9916912d-6ab3-406b-b3df-25bf4dda7998/file', 'properties': {}}, 'image_service': } Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Trying to clone c939a83e-044d-43e1-aa69-aead43fc4f4f from image 9916912d-6ab3-406b-b3df-25bf4dda7998 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9916912d-6ab3-406b-b3df-25bf4dda7998', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccfd94e-d32b-4bd3-b67c-a2211e199cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '220fb968-9789-40d6-bd62-1776898c49fe', 'volume_name': 'volume-220fb968-9789-40d6-bd62-1776898c49fe', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32029a92-c60f-458d-8a33-f65572100855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32029a92-c60f-458d-8a33-f65572100855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda75c1f-7f63-4eb9-bc2e-650c6d1f3c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:30 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Volume 220fb968-9789-40d6-bd62-1776898c49fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-220fb968-9789-40d6-bd62-1776898c49fe', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Trying to clone 220fb968-9789-40d6-bd62-1776898c49fe from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:14:30 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394" returned: 0 in 0.503s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:30 devstack sudo[94291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394 Sep 16 16:14:30 devstack sudo[94291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:30 devstack sudo[94291]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:14:30 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Image download 20.69 MB at 20.69 MB/s Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adfb292f-7147-4197-9725-ff897e16d394" returned: 0 in 0.386s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-quobyte-adfb292f-7147-4197-9725-ff897e16d394" released by "delete_volume" :: held 0.988s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcde267a-0cfa-4458-b23d-a8035ae69c1c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Created reservations ['67da3a0c-8312-44d5-8017-8e90574a1773', 'b3d482a2-985c-4d23-b894-a6b545bf33ca', 'd40fc067-c7dc-4e1b-9866-2e85d4116eca', '43ca012f-e980-468f-bd56-07b96388d93d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:14:31 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD Sep 16 16:14:31 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:31 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:14:31 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:31 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c is fetched for user 305013e6f4e1441da40835126f0bdc35. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb72f486-f69a-40ce-8b84-626b348df854]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:31 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.398s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:14:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Deleted volume successfully. Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cc69b829-ae6b-4c6b-947a-f0dbc870759c tempest-AttachVolumeTestJSON-933576402 None] Lock "cinder-adfb292f-7147-4197-9725-ff897e16d394-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:31 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD Sep 16 16:14:31 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:31 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-645032661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=220fb968-9789-40d6-bd62-1776898c49fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67bf463e4294ffc908ea75253343c1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:30Z,use_quota=True,user_id='305013e6f4e1441da40835126f0bdc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Creating volume 220fb968-9789-40d6-bd62-1776898c49fe {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:31 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:31 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe 1073741824 Sep 16 16:14:31 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:32 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe 1073741824" returned: 0 in 0.577s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:32 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe Sep 16 16:14:32 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0230e440-b538-433d-a14f-b347a32177b2 tempest-GroupsV320Test-891504816 None] Group tempest-GroupsV320Test-Group-551323778: creating Sep 16 16:14:32 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe" returned: 0 in 0.344s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0230e440-b538-433d-a14f-b347a32177b2 tempest-GroupsV320Test-891504816 None] Group tempest-GroupsV320Test-Group-551323778: created successfully Sep 16 16:14:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0230e440-b538-433d-a14f-b347a32177b2 tempest-GroupsV320Test-891504816 None] Create group completed successfully. Sep 16 16:14:32 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Attempting download of cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume 220fb968-9789-40d6-bd62-1776898c49fe. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:14:33 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae602425-2276-4930-b7af-397bf24d59a4]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_aaunccgm {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:33 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_aaunccgm Sep 16 16:14:33 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:33 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_aaunccgm" returned: 0 in 0.370s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_aaunccgm {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:33 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_aaunccgm Sep 16 16:14:33 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:33 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_aaunccgm" returned: 1 in 0.391s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_aaunccgm' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:14:33 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bf2a50-53a4-45d8-835f-b4282ed12b49]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:33 devstack sudo[94327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD Sep 16 16:14:33 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:34 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] cceeac4d-0fa7-4694-a045-5c6e3d003f4c was qcow2, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:34 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe Sep 16 16:14:34 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] Created reservations ['f2b50131-7be7-469f-93c0-c07daa5835e0'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:34 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:14:34 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:35 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:35 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:14:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-488734e5-7f1e-4303-8977-667384c2c4d6 tempest-GroupsV320Test-891504816 None] Delete group completed successfully. Sep 16 16:14:35 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD, size 20.69 MB, duration 4.82 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:14:35 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Image download 20.69 MB at 4.29 MB/s Sep 16 16:14:35 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f206a2ed-ec13-478c-8876-0843dc1d026b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:35 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD Sep 16 16:14:35 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:35 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:35 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Temporary image 9916912d-6ab3-406b-b3df-25bf4dda7998 is fetched for user 989ff795f905417689acb041d4245098. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:14:35 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af517ff-c861-4ea0-882a-79c67f68925e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:35 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD Sep 16 16:14:35 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:36 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-997844807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c939a83e-044d-43e1-aa69-aead43fc4f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e9d4629226f4b32a4059906a56b4fbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:29Z,use_quota=True,user_id='989ff795f905417689acb041d4245098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0779d330-6f55-4fa2-a97b-5933e1af25c0),volume_type_id=0779d330-6f55-4fa2-a97b-5933e1af25c0)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Creating volume c939a83e-044d-43e1-aa69-aead43fc4f4f {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:36 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:36 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f 1073741824 Sep 16 16:14:36 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:36 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f 1073741824" returned: 0 in 0.624s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:36 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f Sep 16 16:14:36 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:36 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe" returned: 0 in 2.515s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_4ipsqstbdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:14:36 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Converted 112.00 MB image at 44.50 MB/s Sep 16 16:14:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:36 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe 1G Sep 16 16:14:36 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:37 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f" returned: 0 in 0.283s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Attempting download of 9916912d-6ab3-406b-b3df-25bf4dda7998 ((None, [{'url': 'file:///opt/stack/data/glance/images/9916912d-6ab3-406b-b3df-25bf4dda7998', 'metadata': {}}])) to volume c939a83e-044d-43e1-aa69-aead43fc4f4f. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[836d6ca7-b645-4e14-9bc7-a893c638ed38]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9916912d-6ab3-406b-b3df-25bf4dda7998_t96iwr_c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:37 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9916912d-6ab3-406b-b3df-25bf4dda7998_t96iwr_c Sep 16 16:14:37 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe 1G" returned: 0 in 0.415s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Downloaded image cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume 220fb968-9789-40d6-bd62-1776898c49fe successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:14:37 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c for user 305013e6f4e1441da40835126f0bdc35 is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Marking volume 220fb968-9789-40d6-bd62-1776898c49fe as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Copying metadata from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c to 220fb968-9789-40d6-bd62-1776898c49fe. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Creating volume glance metadata for volume 220fb968-9789-40d6-bd62-1776898c49fe backed by image cceeac4d-0fa7-4694-a045-5c6e3d003f4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda75c1f-7f63-4eb9-bc2e-650c6d1f3c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220fb968-9789-40d6-bd62-1776898c49fe', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67a4ad9-7fb1-4674-94ee-da589fee67fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Volume volume-220fb968-9789-40d6-bd62-1776898c49fe (220fb968-9789-40d6-bd62-1776898c49fe): created successfully Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67a4ad9-7fb1-4674-94ee-da589fee67fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Flow 'volume_create_manager' (197c54e4-24ee-465a-b171-1d5b17d95529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-97a15e44-f341-466e-b549-62a3a5ae5c46 tempest-ServerActionsTestOtherA-2099364010 None] Created volume successfully. Sep 16 16:14:37 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9916912d-6ab3-406b-b3df-25bf4dda7998_t96iwr_c" returned: 0 in 0.403s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9916912d-6ab3-406b-b3df-25bf4dda7998_t96iwr_c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:37 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9916912d-6ab3-406b-b3df-25bf4dda7998_t96iwr_c Sep 16 16:14:37 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:38 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9916912d-6ab3-406b-b3df-25bf4dda7998_t96iwr_c" returned: 1 in 0.467s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9916912d-6ab3-406b-b3df-25bf4dda7998_t96iwr_c' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:14:38 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4673f73-652f-47e3-8444-2aa39982b462]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:38 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD Sep 16 16:14:38 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:38 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:38 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] 9916912d-6ab3-406b-b3df-25bf4dda7998 was qcow2, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:14:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:38 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f Sep 16 16:14:38 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:41 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f" returned: 0 in 2.986s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9916912d-6ab3-406b-b3df-25bf4dda7998_klcaal1sdevstack@QuobyteHD, size 112.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:14:41 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Converted 112.00 MB image at 37.48 MB/s Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:41 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f 1G Sep 16 16:14:41 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:41 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:14:41 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:41 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f 1G" returned: 0 in 0.497s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:41 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Downloaded image 9916912d-6ab3-406b-b3df-25bf4dda7998 ((None, [{'url': 'file:///opt/stack/data/glance/images/9916912d-6ab3-406b-b3df-25bf4dda7998', 'metadata': {}}])) to volume c939a83e-044d-43e1-aa69-aead43fc4f4f successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Temporary image 9916912d-6ab3-406b-b3df-25bf4dda7998 for user 989ff795f905417689acb041d4245098 is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Marking volume c939a83e-044d-43e1-aa69-aead43fc4f4f as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Copying metadata from image 9916912d-6ab3-406b-b3df-25bf4dda7998 to c939a83e-044d-43e1-aa69-aead43fc4f4f. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Creating volume glance metadata for volume c939a83e-044d-43e1-aa69-aead43fc4f4f backed by image 9916912d-6ab3-406b-b3df-25bf4dda7998 with: {'image_id': '9916912d-6ab3-406b-b3df-25bf4dda7998', 'image_name': 'tempest-scenario-img--159528075', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e12983-51f4-4829-83c9-cb73c4ce5b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c939a83e-044d-43e1-aa69-aead43fc4f4f', 'volume_size': 1, 'image_id': '9916912d-6ab3-406b-b3df-25bf4dda7998', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9916912d-6ab3-406b-b3df-25bf4dda7998', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--159528075', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5e9d4629226f4b32a4059906a56b4fbb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9916912d-6ab3-406b-b3df-25bf4dda7998', 'created_at': datetime.datetime(2026, 9, 16, 14, 14, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9916912d-6ab3-406b-b3df-25bf4dda7998/file', 'properties': {}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:42 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efe5298-f834-41a8-8098-543b6ef15bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.446s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:14:42 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Volume volume-c939a83e-044d-43e1-aa69-aead43fc4f4f (c939a83e-044d-43e1-aa69-aead43fc4f4f): created successfully Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5efe5298-f834-41a8-8098-543b6ef15bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Flow 'volume_create_manager' (7187425d-a94d-4483-a1f1-724f8700c50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-bc8a6694-2df5-44f1-96b7-26d8c27b3b97 tempest-TestInstancesWithCinderVolumes-525979578 None] Created volume successfully. Sep 16 16:14:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-a52b93ad-6588-4afc-b73d-2b522e8b4c06 req-97b5bd75-fee0-4ae1-aa57-043e4df513b1 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-a52b93ad-6588-4afc-b73d-2b522e8b4c06 req-97b5bd75-fee0-4ae1-aa57-043e4df513b1 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-a52b93ad-6588-4afc-b73d-2b522e8b4c06 req-97b5bd75-fee0-4ae1-aa57-043e4df513b1 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-a52b93ad-6588-4afc-b73d-2b522e8b4c06 req-97b5bd75-fee0-4ae1-aa57-043e4df513b1 tempest-ServerActionsTestOtherA-2099364010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-220fb968-9789-40d6-bd62-1776898c49fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ebab07b-ff59-4dbb-932e-d8b1fc68f483', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:14:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-a52b93ad-6588-4afc-b73d-2b522e8b4c06 req-97b5bd75-fee0-4ae1-aa57-043e4df513b1 tempest-ServerActionsTestOtherA-2099364010 None] attachment_update completed successfully. Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Flow 'volume_create_manager' (51c8a818-08ab-4d02-baff-a1ee5d44b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca84832-57ac-462d-b847-c9095180a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca84832-57ac-462d-b847-c9095180a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1532657158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45cc379-be86-4388-b5fb-2d8082053e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ba72f1bf7a4b42add8630cbb9d8418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:45Z,use_quota=True,user_id='d488df29bea94ee49eb99dac83d1bc19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7ccf65-216b-4b60-8a3e-59d4561c5561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7ccf65-216b-4b60-8a3e-59d4561c5561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e734e20-44de-48b5-907b-2905e2145f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e734e20-44de-48b5-907b-2905e2145f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45cc379-be86-4388-b5fb-2d8082053e63', 'volume_name': 'volume-f45cc379-be86-4388-b5fb-2d8082053e63', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f93a87-3ad9-48f5-be6a-91625f5ad9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f93a87-3ad9-48f5-be6a-91625f5ad9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6805ff86-18e0-4add-8893-a33e81ac7d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:45 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Volume f45cc379-be86-4388-b5fb-2d8082053e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45cc379-be86-4388-b5fb-2d8082053e63', 'volume_size': 1} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1532657158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45cc379-be86-4388-b5fb-2d8082053e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67ba72f1bf7a4b42add8630cbb9d8418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:14:45Z,use_quota=True,user_id='d488df29bea94ee49eb99dac83d1bc19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Creating volume f45cc379-be86-4388-b5fb-2d8082053e63 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:14:45 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:14:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:45 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 1073741824 Sep 16 16:14:45 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:46 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 1073741824" returned: 0 in 0.817s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:46 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 Sep 16 16:14:46 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:46 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63" returned: 0 in 0.400s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-b7756b2a-0445-4dbb-92e5-1c597cdc048a req-6839bf29-f37c-42f5-b55d-f1a0920978fc tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-b7756b2a-0445-4dbb-92e5-1c597cdc048a req-6839bf29-f37c-42f5-b55d-f1a0920978fc tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-b7756b2a-0445-4dbb-92e5-1c597cdc048a req-6839bf29-f37c-42f5-b55d-f1a0920978fc tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6805ff86-18e0-4add-8893-a33e81ac7d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45cc379-be86-4388-b5fb-2d8082053e63', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc47e26c-ff4d-4e8e-bfa5-5d01960e6c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:14:46 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Volume volume-f45cc379-be86-4388-b5fb-2d8082053e63 (f45cc379-be86-4388-b5fb-2d8082053e63): created successfully Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc47e26c-ff4d-4e8e-bfa5-5d01960e6c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Flow 'volume_create_manager' (51c8a818-08ab-4d02-baff-a1ee5d44b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:14:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-b7756b2a-0445-4dbb-92e5-1c597cdc048a req-6839bf29-f37c-42f5-b55d-f1a0920978fc tempest-TestInstancesWithCinderVolumes-525979578 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-c939a83e-044d-43e1-aa69-aead43fc4f4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd2638ca-b64d-4204-b2c1-52d3e15bcd8c', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:14:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-078d531c-b8e1-4208-9efc-3067ca78e23c req-307a0e3d-60e1-48b9-88f7-9a9707304539 tempest-VolumesSnapshotsTestJSON-1930261939 None] Created volume successfully. Sep 16 16:14:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-b7756b2a-0445-4dbb-92e5-1c597cdc048a req-6839bf29-f37c-42f5-b55d-f1a0920978fc tempest-TestInstancesWithCinderVolumes-525979578 None] attachment_update completed successfully. Sep 16 16:14:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:14:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:14:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Creating offline snapshot 5349e973-4c39-4125-8821-b68f4aededcc of volume f45cc379-be86-4388-b5fb-2d8082053e63 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:14:48 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede650b9-8bfd-47de-8b22-645b6669afdd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:48 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 Sep 16 16:14:48 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:49 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63" returned: 0 in 0.827s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:49 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc 1G Sep 16 16:14:49 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:49 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc 1G" returned: 0 in 0.653s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f45cc379-be86-4388-b5fb-2d8082053e63 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:49 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f45cc379-be86-4388-b5fb-2d8082053e63 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc Sep 16 16:14:49 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:50 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f45cc379-be86-4388-b5fb-2d8082053e63 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc" returned: 0 in 0.613s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:50 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc is being set with open permissions: ugo+rw Sep 16 16:14:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:50 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc Sep 16 16:14:50 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:50 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc" returned: 0 in 0.602s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:51 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.info Sep 16 16:14:51 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:51 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.info" returned: 0 in 0.436s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:51 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.info is being set with open permissions: ugo+rw Sep 16 16:14:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:51 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.info Sep 16 16:14:51 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:52 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.info" returned: 0 in 0.760s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.113s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:14:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-0c3d5755-073a-4afa-b3af-480f6b078b81 req-3d09e8a1-df6e-4e16-8924-b309b766b067 tempest-VolumesSnapshotsTestJSON-1930261939 None] Create snapshot completed successfully Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Acquiring lock "cinder-5349e973-4c39-4125-8821-b68f4aededcc-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-5349e973-4c39-4125-8821-b68f4aededcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Acquiring lock "cinder-quobyte-f45cc379-be86-4388-b5fb-2d8082053e63" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-quobyte-f45cc379-be86-4388-b5fb-2d8082053e63" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Acquiring lock "cinder-quobyte-5349e973-4c39-4125-8821-b68f4aededcc" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-quobyte-5349e973-4c39-4125-8821-b68f4aededcc" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Deleting offline snapshot 5349e973-4c39-4125-8821-b68f4aededcc of volume f45cc379-be86-4388-b5fb-2d8082053e63 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] snapshot_file for this snap is: volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7852ae-f08b-45b8-ac0c-4e792ef2fc7e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:54 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc Sep 16 16:14:54 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:54 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc" returned: 0 in 0.783s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f45cc379-be86-4388-b5fb-2d8082053e63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:14:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabaa88d-1069-4c84-9c61-1a320f5ddc4c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:55 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 Sep 16 16:14:55 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:55 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63" returned: 0 in 1.169s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:55 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc Sep 16 16:14:55 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:56 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc" returned: 0 in 0.996s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:56 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc Sep 16 16:14:56 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:14:57 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 16 16:14:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63.5349e973-4c39-4125-8821-b68f4aededcc" returned: 0 in 0.983s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:14:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-quobyte-5349e973-4c39-4125-8821-b68f4aededcc" released by "_delete_snapshot" :: held 4.265s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-quobyte-f45cc379-be86-4388-b5fb-2d8082053e63" released by "delete_snapshot" :: held 4.346s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:58 devstack cinder-volume[86255]: DEBUG cinder.quota [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Created reservations ['3daa5d35-c4a7-45f9-ac5b-8e38ff516802', 'd6ef68ae-5945-4de0-acab-333fdc529d2d', 'e1183273-2553-4b8b-82e4-05bd48f6d71e', '4b485340-59bc-4dc9-b3fc-2f8845609653'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:14:58 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Delete snapshot completed successfully. Sep 16 16:14:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ed2534f3-d1cb-445c-8f36-e712371dcc1a req-971a52f1-e64b-46ad-b765-12f4ee68b36e tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-5349e973-4c39-4125-8821-b68f4aededcc-delete_snapshot" released by "delete_snapshot" :: held 4.695s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:14:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Acquiring lock "cinder-f45cc379-be86-4388-b5fb-2d8082053e63-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-f45cc379-be86-4388-b5fb-2d8082053e63-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Acquiring lock "cinder-quobyte-f45cc379-be86-4388-b5fb-2d8082053e63" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:14:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-quobyte-f45cc379-be86-4388-b5fb-2d8082053e63" acquired by "delete_volume" :: waited 0.044s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:14:59 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd27977a-6c59-4a12-8074-e395b920da44]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:14:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:14:59 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 Sep 16 16:14:59 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:00 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63" returned: 0 in 1.161s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:00 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63 Sep 16 16:15:00 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:01 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f45cc379-be86-4388-b5fb-2d8082053e63" returned: 0 in 0.663s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-quobyte-f45cc379-be86-4388-b5fb-2d8082053e63" released by "delete_volume" :: held 2.008s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:01 devstack cinder-volume[86255]: DEBUG cinder.quota [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Created reservations ['99047b58-7f63-4334-ab0f-544f454d66b0', '87e967dd-6cd9-4eaf-81b7-5c7e05f68959', '9103585d-f2d8-438f-a285-93ba026fcf32', 'a6fc06dc-ec86-479c-9fed-85e84d41016a'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:15:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:01 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:15:01 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:02 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.555s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:02 devstack cinder-volume[86255]: DEBUG cinder.manager [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:15:02 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Deleted volume successfully. Sep 16 16:15:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-daa11b13-3c84-4374-a167-1cb3852ad176 req-be626dc4-cfde-4543-8ebe-2305381270c1 tempest-VolumesSnapshotsTestJSON-1930261939 None] Lock "cinder-f45cc379-be86-4388-b5fb-2d8082053e63-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:11 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=125,cinder:UPDATE=106,cinder:INSERT=29,cinder:DELETE=5 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:15:12 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=105,cinder:SELECT=100,cinder:INSERT=37,cinder:DELETE=13 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Flow 'volume_create_manager' (d5195c8b-d1e0-4fa2-a23f-319abe66f061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2335fc42-5ca6-47ec-9c9a-d1faee579ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2335fc42-5ca6-47ec-9c9a-d1faee579ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1912179166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5cea978-fb42-44d4-babc-7fb21d9ee218,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f108fa835e04ca7bb0bb1f5cc0e4b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:13Z,use_quota=True,user_id='849937ffe72f4d7c90788449eeeaef38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e699ce6-9af4-439e-a372-7d898d3cc951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e699ce6-9af4-439e-a372-7d898d3cc951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d94a65-ee40-48eb-a9f4-6b8f002d0087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d94a65-ee40-48eb-a9f4-6b8f002d0087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5cea978-fb42-44d4-babc-7fb21d9ee218', 'volume_name': 'volume-a5cea978-fb42-44d4-babc-7fb21d9ee218', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad4953e-02b6-4ec6-8745-e02cbd50c745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad4953e-02b6-4ec6-8745-e02cbd50c745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e6ce9f-094f-4894-ad53-fa55dc96fe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:13 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Volume a5cea978-fb42-44d4-babc-7fb21d9ee218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5cea978-fb42-44d4-babc-7fb21d9ee218', 'volume_size': 1} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1912179166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5cea978-fb42-44d4-babc-7fb21d9ee218,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f108fa835e04ca7bb0bb1f5cc0e4b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:13Z,use_quota=True,user_id='849937ffe72f4d7c90788449eeeaef38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Creating volume a5cea978-fb42-44d4-babc-7fb21d9ee218 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:15:13 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:13 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-e3e5c101-2ffd-4e3d-9c21-f1ffb072f86d req-bc88d468-5e8e-425b-9b74-28c5f831b90f tempest-ServerActionsTestOtherA-2099364010 None] Terminate volume connection completed successfully. Sep 16 16:15:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-e3e5c101-2ffd-4e3d-9c21-f1ffb072f86d req-bc88d468-5e8e-425b-9b74-28c5f831b90f tempest-ServerActionsTestOtherA-2099364010 None] Deleting attachment 1ebab07b-ff59-4dbb-932e-d8b1fc68f483. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:15:13 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 1073741824 Sep 16 16:15:13 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:14 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 1073741824" returned: 0 in 0.985s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:14 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 Sep 16 16:15:14 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:14 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218" returned: 0 in 0.415s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:15:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e6ce9f-094f-4894-ad53-fa55dc96fe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5cea978-fb42-44d4-babc-7fb21d9ee218', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e64f11-2442-4cb1-8810-a0c6b341ce69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:15 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Volume volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 (a5cea978-fb42-44d4-babc-7fb21d9ee218): created successfully Sep 16 16:15:15 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e64f11-2442-4cb1-8810-a0c6b341ce69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:15 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Flow 'volume_create_manager' (d5195c8b-d1e0-4fa2-a23f-319abe66f061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:15:15 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-82d52740-cd3b-4b24-abcd-fabbc8acc5c9 req-646408d7-f067-4d8e-a0eb-ecfa2c0236c8 tempest-VolumesGetTestJSON-852016476 None] Created volume successfully. Sep 16 16:15:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e3e5c101-2ffd-4e3d-9c21-f1ffb072f86d req-3646c384-cb59-4bd1-b92e-babf1f65d2e3 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e3e5c101-2ffd-4e3d-9c21-f1ffb072f86d req-3646c384-cb59-4bd1-b92e-babf1f65d2e3 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e3e5c101-2ffd-4e3d-9c21-f1ffb072f86d req-3646c384-cb59-4bd1-b92e-babf1f65d2e3 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-e3e5c101-2ffd-4e3d-9c21-f1ffb072f86d req-3646c384-cb59-4bd1-b92e-babf1f65d2e3 tempest-ServerActionsTestOtherA-2099364010 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-220fb968-9789-40d6-bd62-1776898c49fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e2da28c-eed4-445a-a71b-7cdeaca25726', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:15:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-e3e5c101-2ffd-4e3d-9c21-f1ffb072f86d req-3646c384-cb59-4bd1-b92e-babf1f65d2e3 tempest-ServerActionsTestOtherA-2099364010 None] attachment_update completed successfully. Sep 16 16:15:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Acquiring lock "cinder-a5cea978-fb42-44d4-babc-7fb21d9ee218-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Lock "cinder-a5cea978-fb42-44d4-babc-7fb21d9ee218-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Acquiring lock "cinder-quobyte-a5cea978-fb42-44d4-babc-7fb21d9ee218" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Lock "cinder-quobyte-a5cea978-fb42-44d4-babc-7fb21d9ee218" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:17 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c222deb3-f0cc-401b-8498-2ddb70c075d0]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:17 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 Sep 16 16:15:17 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:18 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218" returned: 0 in 0.536s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:18 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218 Sep 16 16:15:18 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:18 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a5cea978-fb42-44d4-babc-7fb21d9ee218" returned: 0 in 0.355s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Lock "cinder-quobyte-a5cea978-fb42-44d4-babc-7fb21d9ee218" released by "delete_volume" :: held 0.965s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG cinder.quota [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Created reservations ['96f9bd90-1724-4c35-a878-60008fc0353c', '30a09179-db52-4389-9f9c-f59c6107aae8', '90d587e1-b3ac-49da-8bf0-1ce9fe264876', 'd6b3a522-aefe-4cbd-b9ca-adef016afc68'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:18 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:15:18 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:18 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.374s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:18 devstack cinder-volume[86255]: DEBUG cinder.manager [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:15:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Deleted volume successfully. Sep 16 16:15:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-06041fa6-2d0a-4da0-85ba-31178804ed8a req-51e3c7ef-bfee-4fb1-9558-663367618639 tempest-VolumesGetTestJSON-852016476 None] Lock "cinder-a5cea978-fb42-44d4-babc-7fb21d9ee218-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5d59c323-a6aa-4be5-9706-45d88c87f97b tempest-BackendsCapabilitiesAdminTestsJSON-1468172072 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86255) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 16 16:15:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-eb098909-cac9-4ba1-8679-2ff562ca1f66 tempest-BackendsCapabilitiesAdminTestsJSON-1468172072 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86255) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 16 16:15:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-836f51a0-cb12-47bc-8ef7-591058406e7e req-9ea15e98-2ab8-4e71-9577-feb0d115d14b tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-836f51a0-cb12-47bc-8ef7-591058406e7e req-9ea15e98-2ab8-4e71-9577-feb0d115d14b tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-836f51a0-cb12-47bc-8ef7-591058406e7e req-9ea15e98-2ab8-4e71-9577-feb0d115d14b tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-836f51a0-cb12-47bc-8ef7-591058406e7e req-9ea15e98-2ab8-4e71-9577-feb0d115d14b tempest-TestInstancesWithCinderVolumes-525979578 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-5ca7f845-9f09-4c62-ba6b-85da93465841', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f6856af-596f-42b8-9e3c-e67ee41dc5f6', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:15:27 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-836f51a0-cb12-47bc-8ef7-591058406e7e req-9ea15e98-2ab8-4e71-9577-feb0d115d14b tempest-TestInstancesWithCinderVolumes-525979578 None] attachment_update completed successfully. Sep 16 16:15:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-937fcd96-411e-47fc-b3ad-c7252c141873 req-510ac775-375f-47a8-b5f3-344ea0bae4eb tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-937fcd96-411e-47fc-b3ad-c7252c141873 req-510ac775-375f-47a8-b5f3-344ea0bae4eb tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-937fcd96-411e-47fc-b3ad-c7252c141873 req-510ac775-375f-47a8-b5f3-344ea0bae4eb tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-937fcd96-411e-47fc-b3ad-c7252c141873 req-510ac775-375f-47a8-b5f3-344ea0bae4eb tempest-TestInstancesWithCinderVolumes-525979578 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-28296468-2268-4f22-b5b2-3513efb9b14e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebd92c63-aee0-4462-a345-ef8494e4e2f2', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:15:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-937fcd96-411e-47fc-b3ad-c7252c141873 req-510ac775-375f-47a8-b5f3-344ea0bae4eb tempest-TestInstancesWithCinderVolumes-525979578 None] attachment_update completed successfully. Sep 16 16:15:34 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-905a9b67-25a5-4ea5-9596-62520dd6fd02 tempest-GroupsV314Test-1016210077 None] Group tempest-GroupsV314Test-Group-679188886: creating Sep 16 16:15:34 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-905a9b67-25a5-4ea5-9596-62520dd6fd02 tempest-GroupsV314Test-1016210077 None] Group tempest-GroupsV314Test-Group-679188886: created successfully Sep 16 16:15:34 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-905a9b67-25a5-4ea5-9596-62520dd6fd02 tempest-GroupsV314Test-1016210077 None] Create group completed successfully. Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Flow 'volume_create_manager' (a04f4570-4179-4f0b-a87e-e0e86ef7d5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7abbe0-12d8-4d90-8ed3-b20c6f0658d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7abbe0-12d8-4d90-8ed3-b20c6f0658d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-911718943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b96333b-d8c4-4e83-a6d4-fec143f68f57,host='devstack@QuobyteHD#QuobyteHD',id=bd45ed54-07b6-4001-af7e-4b07db391903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16a6a49ef7342579bbaa5a462347699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:36Z,use_quota=True,user_id='465551bc11ed40758abb93032a92dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(415ad39e-8d88-4d0b-8e8d-f8e3237f68e2),volume_type_id=415ad39e-8d88-4d0b-8e8d-f8e3237f68e2)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103df3fc-e373-4475-b0e9-a094b100a94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103df3fc-e373-4475-b0e9-a094b100a94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e325bf17-512c-4820-8d4f-becf35e94fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e325bf17-512c-4820-8d4f-becf35e94fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd45ed54-07b6-4001-af7e-4b07db391903', 'volume_name': 'volume-bd45ed54-07b6-4001-af7e-4b07db391903', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17800599-aa67-4c69-b9e7-b0ec4e93d0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17800599-aa67-4c69-b9e7-b0ec4e93d0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909f0a41-30ea-4a3c-822d-8cce1d2abd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:36 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Volume bd45ed54-07b6-4001-af7e-4b07db391903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd45ed54-07b6-4001-af7e-4b07db391903', 'volume_size': 1} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1b96333b-d8c4-4e83-a6d4-fec143f68f57,created_at=2026-09-16T14:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-911718943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1b96333b-d8c4-4e83-a6d4-fec143f68f57,host='devstack@QuobyteHD#QuobyteHD',id=bd45ed54-07b6-4001-af7e-4b07db391903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b16a6a49ef7342579bbaa5a462347699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:36Z,use_quota=True,user_id='465551bc11ed40758abb93032a92dd01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(415ad39e-8d88-4d0b-8e8d-f8e3237f68e2),volume_type_id=415ad39e-8d88-4d0b-8e8d-f8e3237f68e2)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Creating volume bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:15:36 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:15:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:36 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 1073741824 Sep 16 16:15:36 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:37 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 1073741824" returned: 0 in 0.614s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:37 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 Sep 16 16:15:37 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:37 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903" returned: 0 in 0.318s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:15:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909f0a41-30ea-4a3c-822d-8cce1d2abd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd45ed54-07b6-4001-af7e-4b07db391903', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4975e291-1ac6-4c37-8096-db97ba1fe07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Volume volume-bd45ed54-07b6-4001-af7e-4b07db391903 (bd45ed54-07b6-4001-af7e-4b07db391903): created successfully Sep 16 16:15:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4975e291-1ac6-4c37-8096-db97ba1fe07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Flow 'volume_create_manager' (a04f4570-4179-4f0b-a87e-e0e86ef7d5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:15:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ef302206-5734-4159-a9d9-af4986d65c2b tempest-GroupsV314Test-1016210077 None] Created volume successfully. Sep 16 16:15:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-ed5e53fd-c4d4-4fb7-9a63-5ea39d0455e3 req-b3af0b26-b75d-4a5a-89b7-30a284f88dc8 tempest-TestInstancesWithCinderVolumes-525979578 None] Terminate volume connection completed successfully. Sep 16 16:15:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-ed5e53fd-c4d4-4fb7-9a63-5ea39d0455e3 req-b3af0b26-b75d-4a5a-89b7-30a284f88dc8 tempest-TestInstancesWithCinderVolumes-525979578 None] Deleting attachment 2f6856af-596f-42b8-9e3c-e67ee41dc5f6. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:15:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:38 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Cloning volume bd45ed54-07b6-4001-af7e-4b07db391903 to volume f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb Sep 16 16:15:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Creating offline snapshot 9abc7e59-61a7-4790-8e32-a73c015cab67 of volume bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:15:38 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[602d0603-e807-484b-9275-a93ca59886d4]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:38 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 Sep 16 16:15:38 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:39 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903" returned: 0 in 0.443s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:39 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 1G Sep 16 16:15:39 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "cinder-5ca7f845-9f09-4c62-ba6b-85da93465841-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-5ca7f845-9f09-4c62-ba6b-85da93465841-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "cinder-quobyte-5ca7f845-9f09-4c62-ba6b-85da93465841" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-quobyte-5ca7f845-9f09-4c62-ba6b-85da93465841" acquired by "delete_volume" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29fcf9b-6336-44fa-86a8-aef8cda9d316]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:39 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841 Sep 16 16:15:39 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:39 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 1G" returned: 0 in 0.600s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd45ed54-07b6-4001-af7e-4b07db391903 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:39 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd45ed54-07b6-4001-af7e-4b07db391903 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 Sep 16 16:15:39 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:39 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841" returned: 0 in 0.496s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:39 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841 Sep 16 16:15:39 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:40 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd45ed54-07b6-4001-af7e-4b07db391903 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67" returned: 0 in 0.429s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:40 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:40 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 Sep 16 16:15:40 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:40 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ca7f845-9f09-4c62-ba6b-85da93465841" returned: 0 in 0.341s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-quobyte-5ca7f845-9f09-4c62-ba6b-85da93465841" released by "delete_volume" :: held 0.911s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:40 devstack cinder-volume[86255]: WARNING cinder.quota [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1389869274-1276610342 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1389869274-1276610342, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:15:40 devstack cinder-volume[86255]: WARNING cinder.quota [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1389869274-1276610342 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1389869274-1276610342, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Created reservations ['e2a64455-535f-4f8f-8a8f-57739517f30c', 'd8bff637-0c28-4eb1-83ff-3cd7faf04843', '14de816e-023d-4eef-b17e-dcc474cba4f8', '7feaffd4-4fe3-47d6-93ad-5f2fa2b6d40f'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:40 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67" returned: 0 in 0.388s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:40 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:15:40 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:40 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.info Sep 16 16:15:40 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:40 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.364s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:15:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Deleted volume successfully. Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93fc41b7-aa2a-4b99-9945-6e9dd4699988 tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-5ca7f845-9f09-4c62-ba6b-85da93465841-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:40 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.info" returned: 0 in 0.373s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:40 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:15:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:40 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.info Sep 16 16:15:40 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:41 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.info" returned: 0 in 0.301s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Acquiring lock "cinder-quobyte-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Lock "cinder-quobyte-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] snapshot: 9abc7e59-61a7-4790-8e32-a73c015cab67, volume: f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb01b14-0fbf-4fda-bed1-4e5fe6fd8f96]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:41 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 Sep 16 16:15:41 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:15:41 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67" returned: 0 in 0.511s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd45ed54-07b6-4001-af7e-4b07db391903(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e78e72d-a9d5-47d4-8331-c5c625fc5d8f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:42 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 Sep 16 16:15:42 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:42 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903" returned: 0 in 0.549s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:15:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:15:42 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:15:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:42 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb Sep 16 16:15:42 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Flow 'volume_create_manager' (5575e304-c3e3-451b-95ac-c01c8ec630d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c9a051-77c9-4ff9-9f26-31702d24423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c9a051-77c9-4ff9-9f26-31702d24423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1326846691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914a6c42-1d54-4994-ac2f-8419f69dc0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bf7525a81f4cf98ff09fe5c3c2e091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:44Z,use_quota=True,user_id='1ec5f5e812884b129a5d589208b3bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c9a3eb-f960-4d70-9a15-bdca2c611757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c9a3eb-f960-4d70-9a15-bdca2c611757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1527b6da-6be0-4925-982a-69a3cc3904c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1527b6da-6be0-4925-982a-69a3cc3904c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914a6c42-1d54-4994-ac2f-8419f69dc0ee', 'volume_name': 'volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb890bd7-f218-44c8-8e8d-6db2e06064e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb890bd7-f218-44c8-8e8d-6db2e06064e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522d6405-6ddc-4903-9f01-7f4c153a4af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:44 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Volume 914a6c42-1d54-4994-ac2f-8419f69dc0ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee', 'volume_size': 1} Sep 16 16:15:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-b23b954b-b940-4451-b3bd-b719a45ce2fa req-280057ad-7567-4194-bd63-07dd6863dcec tempest-TestInstancesWithCinderVolumes-525979578 None] Terminate volume connection completed successfully. Sep 16 16:15:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-b23b954b-b940-4451-b3bd-b719a45ce2fa req-280057ad-7567-4194-bd63-07dd6863dcec tempest-TestInstancesWithCinderVolumes-525979578 None] Deleting attachment ebd92c63-aee0-4462-a345-ef8494e4e2f2. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:15:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "cinder-28296468-2268-4f22-b5b2-3513efb9b14e-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-28296468-2268-4f22-b5b2-3513efb9b14e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "cinder-quobyte-28296468-2268-4f22-b5b2-3513efb9b14e" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-quobyte-28296468-2268-4f22-b5b2-3513efb9b14e" acquired by "delete_volume" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:46 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c1922f-af16-4f2d-9270-71e145bfc51b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:46 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e Sep 16 16:15:46 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:47 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e" returned: 0 in 1.006s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:47 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e Sep 16 16:15:47 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:47 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-28296468-2268-4f22-b5b2-3513efb9b14e" returned: 0 in 0.464s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-quobyte-28296468-2268-4f22-b5b2-3513efb9b14e" released by "delete_volume" :: held 1.611s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:47 devstack cinder-volume[86255]: WARNING cinder.quota [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-224001388-63227693 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-224001388-63227693, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:15:47 devstack cinder-volume[86255]: WARNING cinder.quota [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-224001388-63227693 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-224001388-63227693, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:15:47 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Created reservations ['9f8ba4d9-4d6f-40e7-bfd9-4be66508f02e', '1f8d9c20-166e-414a-95ca-2aec58d0246b', '9a958549-ecb3-42bb-84de-05ec660ea345', 'bc9a5337-97f7-4b86-b74b-4c10a7798d68'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:15:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:48 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:15:48 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:49 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.877s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:49 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:15:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Deleted volume successfully. Sep 16 16:15:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-89c1cae0-3b35-4706-a75f-6e0feb7a871c tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-28296468-2268-4f22-b5b2-3513efb9b14e-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-e768d496-b28a-485d-809b-60b76e2e7911 req-c5090b31-57c2-439a-8a1b-86b36b47d00b tempest-ServerActionsTestOtherA-2099364010 None] Terminate volume connection completed successfully. Sep 16 16:15:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-e768d496-b28a-485d-809b-60b76e2e7911 req-c5090b31-57c2-439a-8a1b-86b36b47d00b tempest-ServerActionsTestOtherA-2099364010 None] Deleting attachment 8e2da28c-eed4-445a-a71b-7cdeaca25726. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:15:52 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" returned: 0 in 10.483s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:52 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903, size 1024.00 MB, duration 10.48 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:15:52 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Converted 1024.00 MB image at 97.67 MB/s Sep 16 16:15:52 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:15:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:52 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb Sep 16 16:15:52 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "cinder-220fb968-9789-40d6-bd62-1776898c49fe-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Lock "cinder-220fb968-9789-40d6-bd62-1776898c49fe-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "cinder-quobyte-220fb968-9789-40d6-bd62-1776898c49fe" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Lock "cinder-quobyte-220fb968-9789-40d6-bd62-1776898c49fe" acquired by "delete_volume" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc45bfaa-1a0b-412b-a38a-997219625136]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:53 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe Sep 16 16:15:53 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:53 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" returned: 0 in 0.623s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Lock "cinder-quobyte-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" released by "_copy_volume_from_snapshot" :: held 12.301s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Acquiring lock "cinder-quobyte-9abc7e59-61a7-4790-8e32-a73c015cab67" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Lock "cinder-quobyte-9abc7e59-61a7-4790-8e32-a73c015cab67" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Deleting offline snapshot 9abc7e59-61a7-4790-8e32-a73c015cab67 of volume bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] snapshot_file for this snap is: volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0665c-262c-4755-a65f-a8443601600d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:53 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe" returned: 0 in 0.560s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:53 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe Sep 16 16:15:53 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:53 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 Sep 16 16:15:53 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:54 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-220fb968-9789-40d6-bd62-1776898c49fe" returned: 0 in 0.401s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Lock "cinder-quobyte-220fb968-9789-40d6-bd62-1776898c49fe" released by "delete_volume" :: held 1.048s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG cinder.quota [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Created reservations ['02ec112d-4f89-4c49-a2c2-2778be374ec1', '22f04bc0-175d-4ddc-bad3-0cbdf85f3a1c', 'ed61bda3-534b-4495-863b-7626b2b167cf', '10d16ce8-e9a8-4fa5-87dd-43cbb785d032'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:15:54 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67" returned: 0 in 0.671s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd45ed54-07b6-4001-af7e-4b07db391903(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[345bb9e4-eacb-450c-8350-417d453cd9e6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "cinder-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:54 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 Sep 16 16:15:54 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:54 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:15:54 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Lock "cinder-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "cinder-quobyte-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Lock "cinder-quobyte-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[093b59f3-39e0-48e1-a81b-e2f61775217c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:55 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 Sep 16 16:15:55 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:55 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.478s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG cinder.manager [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:15:55 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Deleted volume successfully. Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-e768d496-b28a-485d-809b-60b76e2e7911 req-a4666f92-3b92-4820-8289-38f1e91c96f2 tempest-ServerActionsTestOtherA-2099364010 None] Lock "cinder-220fb968-9789-40d6-bd62-1776898c49fe-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:55 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903" returned: 0 in 0.969s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:55 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 Sep 16 16:15:55 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:55 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18" returned: 0 in 0.545s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:55 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18 Sep 16 16:15:55 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:55 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18" returned: 0 in 0.384s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Lock "cinder-quobyte-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18" released by "delete_volume" :: held 1.021s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:55 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67" returned: 0 in 0.542s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:55 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67 Sep 16 16:15:55 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:55 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-889ba9ce-502e-4e52-a669-d8c7acf4e5de req-7a0a93f8-b7c0-4b3b-b9c3-ab5b18d10b82 tempest-TestInstancesWithCinderVolumes-525979578 None] Terminate volume connection completed successfully. Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-889ba9ce-502e-4e52-a669-d8c7acf4e5de req-7a0a93f8-b7c0-4b3b-b9c3-ab5b18d10b82 tempest-TestInstancesWithCinderVolumes-525979578 None] Deleting attachment fd2638ca-b64d-4204-b2c1-52d3e15bcd8c. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:15:55 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Created reservations ['04400c56-6ccb-4471-ae4b-4527461ee76e', '38653d62-21f3-472b-a4ac-7cd04f03a8f7', '3c02e0ed-a9ed-4ef9-8305-5e5199dfa1bb', '22d5096f-9522-4a6c-8048-6923348f2284'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:56 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:15:56 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:56 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903.9abc7e59-61a7-4790-8e32-a73c015cab67" returned: 0 in 0.296s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Lock "cinder-quobyte-9abc7e59-61a7-4790-8e32-a73c015cab67" released by "_delete_snapshot" :: held 2.649s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.787s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.697s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1326846691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914a6c42-1d54-4994-ac2f-8419f69dc0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bf7525a81f4cf98ff09fe5c3c2e091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:44Z,use_quota=True,user_id='1ec5f5e812884b129a5d589208b3bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Creating volume 914a6c42-1d54-4994-ac2f-8419f69dc0ee {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:15:56 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:56 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee 1073741824 Sep 16 16:15:56 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:56 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.359s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:15:56 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Deleted volume successfully. Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-bc211d6a-4a29-466c-82c3-2e377c2cf119 tempest-ServerActionsTestOtherA-2099364010 None] Lock "cinder-fc3edab7-5bc0-49f4-9e7d-e8c582de2f18-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:56 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-31ebef14-f8d7-4801-8cf7-fa3a44265000 tempest-GroupsV314Test-1016210077 None] Create group from source-group-1b96333b-d8c4-4e83-a6d4-fec143f68f57 completed successfully. Sep 16 16:15:56 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee 1073741824" returned: 0 in 0.562s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:56 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee Sep 16 16:15:56 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "cinder-c939a83e-044d-43e1-aa69-aead43fc4f4f-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-c939a83e-044d-43e1-aa69-aead43fc4f4f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "cinder-quobyte-c939a83e-044d-43e1-aa69-aead43fc4f4f" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-quobyte-c939a83e-044d-43e1-aa69-aead43fc4f4f" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b8010-1a40-4d90-a4cc-bbeae8b0325d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:57 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee" returned: 0 in 0.344s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522d6405-6ddc-4903-9f01-7f4c153a4af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0ebb47-216a-4eaf-be1f-d55a0a17b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:57 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f Sep 16 16:15:57 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:57 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Volume volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee (914a6c42-1d54-4994-ac2f-8419f69dc0ee): created successfully Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0ebb47-216a-4eaf-be1f-d55a0a17b574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Flow 'volume_create_manager' (5575e304-c3e3-451b-95ac-c01c8ec630d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:15:57 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1fdc4c7c-0e93-456b-9513-ab6920812881 tempest-VolumesListAdminTestJSON-1555934331 None] Created volume successfully. Sep 16 16:15:57 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f" returned: 0 in 0.626s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:57 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f Sep 16 16:15:57 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:58 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c939a83e-044d-43e1-aa69-aead43fc4f4f" returned: 0 in 0.368s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-quobyte-c939a83e-044d-43e1-aa69-aead43fc4f4f" released by "delete_volume" :: held 1.065s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:58 devstack cinder-volume[86255]: WARNING cinder.quota [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437202804-147449510 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437202804-147449510, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:15:58 devstack cinder-volume[86255]: WARNING cinder.quota [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437202804-147449510 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437202804-147449510, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Created reservations ['658172ba-6557-469c-b45c-2277414f4ab8', '3f83e12a-42aa-4408-a036-133858f1f380', '9de42ab3-4cca-4da3-9f28-54cae85c9362', 'e18761dc-b7d2-49a6-8669-2f135955336b'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:58 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:15:58 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Acquiring lock "cinder-quobyte-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Lock "cinder-quobyte-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[61204e53-1741-491d-879e-cea1c13a57bb]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:15:58 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Flow 'volume_create_manager' (bda8c7e5-050d-4e5f-9e4a-eee0cb174340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a02c51f9-f1e9-4d8e-b88a-228fc2938ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.522s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a02c51f9-f1e9-4d8e-b88a-228fc2938ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1514852454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a29e256-c5b9-4234-8e81-8aa27ac7c427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bf7525a81f4cf98ff09fe5c3c2e091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:59Z,use_quota=True,user_id='1ec5f5e812884b129a5d589208b3bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01992baf-ce23-4cf5-a53c-fcbe0ca16f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01992baf-ce23-4cf5-a53c-fcbe0ca16f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6463cde-5117-462b-ac04-f7f76213f278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6463cde-5117-462b-ac04-f7f76213f278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a29e256-c5b9-4234-8e81-8aa27ac7c427', 'volume_name': 'volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e29db4-12dd-426b-bf80-0c1a9989a41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04e29db4-12dd-426b-bf80-0c1a9989a41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1c69af-545e-4d2f-b4f8-5bbdc4720a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:15:59 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Volume 4a29e256-c5b9-4234-8e81-8aa27ac7c427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427', 'volume_size': 1} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1514852454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a29e256-c5b9-4234-8e81-8aa27ac7c427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bf7525a81f4cf98ff09fe5c3c2e091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:15:59Z,use_quota=True,user_id='1ec5f5e812884b129a5d589208b3bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Creating volume 4a29e256-c5b9-4234-8e81-8aa27ac7c427 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:15:59 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb Sep 16 16:15:59 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:15:59 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:59 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Deleted volume successfully. Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c221421a-d459-4803-9358-413d81fb6cfe tempest-TestInstancesWithCinderVolumes-525979578 None] Lock "cinder-c939a83e-044d-43e1-aa69-aead43fc4f4f-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:59 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 1073741824 Sep 16 16:15:59 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:59 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" returned: 0 in 0.660s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:59 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb Sep 16 16:15:59 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:59 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 1073741824" returned: 0 in 0.706s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:59 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" returned: 0 in 0.347s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Lock "cinder-quobyte-f2f3cb53-f403-470e-94d1-6ff8c8f0cbfb" released by "delete_volume" :: held 1.114s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:15:59 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 Sep 16 16:15:59 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:15:59 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Created reservations ['372b7bde-6cc6-4fa8-8c21-9c9864d96741'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:15:59 devstack cinder-volume[86255]: WARNING cinder.quota [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-678843897 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-678843897, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:15:59 devstack cinder-volume[86255]: WARNING cinder.quota [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-678843897 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-678843897, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Created reservations ['fe906654-14f2-4bea-8f66-1e55e9aaa14f', 'a6f66cd9-5c0a-4a3c-b3b9-107c77314beb', '44743f25-e83e-4ad8-93b5-6c65ae9ef99c', 'eb0168ca-0661-45eb-8bde-91eaf8329174'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:00 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427" returned: 0 in 0.285s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab1c69af-545e-4d2f-b4f8-5bbdc4720a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bd6730-7386-4792-9134-75cda88d2032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:00 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Volume volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 (4a29e256-c5b9-4234-8e81-8aa27ac7c427): created successfully Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bd6730-7386-4792-9134-75cda88d2032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Flow 'volume_create_manager' (bda8c7e5-050d-4e5f-9e4a-eee0cb174340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:00 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7902aa48-8268-4dee-96a5-22f5be5bc3e9 tempest-VolumesListAdminTestJSON-1555934331 None] Created volume successfully. Sep 16 16:16:00 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:00 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:00 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:00 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:00 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a5f449b4-7132-4bc0-9e37-767e25fbc05f tempest-GroupsV314Test-1016210077 None] Delete group completed successfully. Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Flow 'volume_create_manager' (be19e6a4-f3f8-4516-a7ee-5578e7236cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3619f83-6921-4e63-8ed7-d3bd07df5d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3619f83-6921-4e63-8ed7-d3bd07df5d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1461155986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a8455b-207b-4acc-bea5-4cd8252ebab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bf7525a81f4cf98ff09fe5c3c2e091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:02Z,use_quota=True,user_id='1ec5f5e812884b129a5d589208b3bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102277b4-d73f-40ce-b822-e612d672ba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102277b4-d73f-40ce-b822-e612d672ba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4420f9b5-8831-4af3-a287-3b968235a2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4420f9b5-8831-4af3-a287-3b968235a2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a8455b-207b-4acc-bea5-4cd8252ebab7', 'volume_name': 'volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31cd826-c80e-4555-b150-a18b74de99ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d31cd826-c80e-4555-b150-a18b74de99ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ee3792-7d1e-4eca-ae4d-b5c964565655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:01 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Volume c4a8455b-207b-4acc-bea5-4cd8252ebab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7', 'volume_size': 1} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1461155986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a8455b-207b-4acc-bea5-4cd8252ebab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bf7525a81f4cf98ff09fe5c3c2e091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:02Z,use_quota=True,user_id='1ec5f5e812884b129a5d589208b3bb74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Creating volume c4a8455b-207b-4acc-bea5-4cd8252ebab7 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:16:01 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Acquiring lock "cinder-quobyte-bd45ed54-07b6-4001-af7e-4b07db391903" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:01 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 1073741824 Sep 16 16:16:01 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Lock "cinder-quobyte-bd45ed54-07b6-4001-af7e-4b07db391903" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257383d-4cc8-43c8-8583-acaa2872526d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:16:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:02 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 Sep 16 16:16:02 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:02 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903" returned: 0 in 0.506s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:02 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 1073741824" returned: 0 in 0.655s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:02 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903 Sep 16 16:16:02 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:02 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 Sep 16 16:16:02 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:02 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:02 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7" returned: 0 in 0.346s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bd45ed54-07b6-4001-af7e-4b07db391903" returned: 0 in 0.459s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Lock "cinder-quobyte-bd45ed54-07b6-4001-af7e-4b07db391903" released by "delete_volume" :: held 1.083s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ee3792-7d1e-4eca-ae4d-b5c964565655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4273051-7b09-414e-81ca-d1424885b73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:02 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Volume volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 (c4a8455b-207b-4acc-bea5-4cd8252ebab7): created successfully Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4273051-7b09-414e-81ca-d1424885b73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Flow 'volume_create_manager' (be19e6a4-f3f8-4516-a7ee-5578e7236cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:03 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-29060471-2929-462f-a454-bccbb5459140 tempest-VolumesListAdminTestJSON-1555934331 None] Created volume successfully. Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Created reservations ['73ec3c12-0c41-4ed0-a26d-34e21ef091e2'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Created reservations ['336433e6-be8f-45a4-b9bc-9a78d461c364', 'c042ab27-07d6-4510-b918-9a6613bb14d8', 'ffe5d206-48ba-4bce-8a4f-afe2ef97f2c5', '59487b8f-a74b-4493-9f3a-a1b70b24aef4'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:03 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:03 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:03 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.391s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:03 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:03 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-167e5c94-7d53-41c9-b0c4-fb43edb1b40b tempest-GroupsV314Test-1016210077 None] Delete group completed successfully. Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Flow 'volume_create_manager' (6d939efc-7e23-4434-95b7-a466a4695082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d05aa8-24e5-4030-b840-938e7ecb9fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d05aa8-24e5-4030-b840-938e7ecb9fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83740b80-30a4-46fb-8519-3ef61939ca35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1344aec47ccd4feeab2bd8088c69fd37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:05Z,use_quota=True,user_id='9cad593d5dd74ef7984327432a1697ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da4c772-e39a-4f1d-8c13-d07b9a012cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da4c772-e39a-4f1d-8c13-d07b9a012cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92498c79-6e39-40d7-b5c1-6105ebcaf28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92498c79-6e39-40d7-b5c1-6105ebcaf28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83740b80-30a4-46fb-8519-3ef61939ca35', 'volume_name': 'volume-83740b80-30a4-46fb-8519-3ef61939ca35', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b72a07-2d40-4083-92b9-261cc40383d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b72a07-2d40-4083-92b9-261cc40383d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ede29d-1499-4592-9fb0-6fc44c3c11d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:05 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Volume 83740b80-30a4-46fb-8519-3ef61939ca35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83740b80-30a4-46fb-8519-3ef61939ca35', 'volume_size': 1} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83740b80-30a4-46fb-8519-3ef61939ca35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1344aec47ccd4feeab2bd8088c69fd37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:05Z,use_quota=True,user_id='9cad593d5dd74ef7984327432a1697ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Creating volume 83740b80-30a4-46fb-8519-3ef61939ca35 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:16:05 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:05 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35 1073741824 Sep 16 16:16:05 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:05 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35 1073741824" returned: 0 in 0.753s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:06 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35 Sep 16 16:16:06 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:06 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35" returned: 0 in 0.243s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:16:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ede29d-1499-4592-9fb0-6fc44c3c11d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83740b80-30a4-46fb-8519-3ef61939ca35', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfb02d2-af1e-4805-8571-9b551bd69071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Volume volume-83740b80-30a4-46fb-8519-3ef61939ca35 (83740b80-30a4-46fb-8519-3ef61939ca35): created successfully Sep 16 16:16:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfb02d2-af1e-4805-8571-9b551bd69071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Flow 'volume_create_manager' (6d939efc-7e23-4434-95b7-a466a4695082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:06 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f85505c1-6144-4920-bd9f-b0e10b4babf0 tempest-VolumesListAdminTestJSON-664525223 None] Created volume successfully. Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Acquiring lock "cinder-83740b80-30a4-46fb-8519-3ef61939ca35-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Lock "cinder-83740b80-30a4-46fb-8519-3ef61939ca35-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Acquiring lock "cinder-quobyte-83740b80-30a4-46fb-8519-3ef61939ca35" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Lock "cinder-quobyte-83740b80-30a4-46fb-8519-3ef61939ca35" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbe3690-ec8e-426a-9de9-94560b77846b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "cinder-c4a8455b-207b-4acc-bea5-4cd8252ebab7-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-c4a8455b-207b-4acc-bea5-4cd8252ebab7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "cinder-quobyte-c4a8455b-207b-4acc-bea5-4cd8252ebab7" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-quobyte-c4a8455b-207b-4acc-bea5-4cd8252ebab7" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9ca6d8-c6f8-4489-92cf-721c0756f835]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:07 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35 Sep 16 16:16:07 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:07 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 Sep 16 16:16:07 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:07 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35" returned: 0 in 0.540s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:08 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35 Sep 16 16:16:08 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:08 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7" returned: 0 in 0.509s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:08 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7 Sep 16 16:16:08 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:08 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83740b80-30a4-46fb-8519-3ef61939ca35" returned: 0 in 0.472s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Lock "cinder-quobyte-83740b80-30a4-46fb-8519-3ef61939ca35" released by "delete_volume" :: held 1.100s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Created reservations ['7d6484e9-3acf-44a5-9f0f-c313dfcf6f89', 'be8cc490-0d7e-4cf0-aea4-93cd2c3fe0e0', 'f8723faa-eaa7-434e-a513-705000fbd6fb', '5138aaf6-9fc5-4fd1-8e86-d5947b1addf3'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:08 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c4a8455b-207b-4acc-bea5-4cd8252ebab7" returned: 0 in 0.451s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-quobyte-c4a8455b-207b-4acc-bea5-4cd8252ebab7" released by "delete_volume" :: held 1.036s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:08 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:08 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:08 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Created reservations ['bf20fd58-353b-40dc-8dac-7f6d5ba400f3', '72f16cf3-ec0d-4dce-b0b3-d9c3ba322d13', 'c3ab058a-6b4c-4204-a91c-e4d392b9a399', 'ff312fde-84d1-4bd8-a6a9-d6aefc062e81'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:09 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:09 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:09 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.425s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Deleted volume successfully. Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0a51df2-02ae-4259-b52f-56bc3eb5af35 tempest-VolumesListAdminTestJSON-664525223 None] Lock "cinder-83740b80-30a4-46fb-8519-3ef61939ca35-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:09 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.330s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Deleted volume successfully. Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a49f4c77-69f2-42ac-b405-12ed890a08ea tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-c4a8455b-207b-4acc-bea5-4cd8252ebab7-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "cinder-4a29e256-c5b9-4234-8e81-8aa27ac7c427-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-4a29e256-c5b9-4234-8e81-8aa27ac7c427-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "cinder-quobyte-4a29e256-c5b9-4234-8e81-8aa27ac7c427" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-quobyte-4a29e256-c5b9-4234-8e81-8aa27ac7c427" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:10 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcc2014-b7c0-4d51-b5e7-7c47c04ef5d5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:16:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:10 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 Sep 16 16:16:10 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:10 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427" returned: 0 in 0.479s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:10 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427 Sep 16 16:16:10 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:10 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4a29e256-c5b9-4234-8e81-8aa27ac7c427" returned: 0 in 0.268s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-quobyte-4a29e256-c5b9-4234-8e81-8aa27ac7c427" released by "delete_volume" :: held 0.818s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:10 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Created reservations ['0fc6c8a6-3a33-42e1-a9a2-1ccb920aa0c8', 'b5b8249e-92c9-44a1-b08c-6bc66b2285f8', '2688b5e6-4488-40e8-a1bd-9d36dd45fa77', '84c4b813-dc33-4230-b955-6b5606b05c84'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:11 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:11 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "cinder-914a6c42-1d54-4994-ac2f-8419f69dc0ee-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-914a6c42-1d54-4994-ac2f-8419f69dc0ee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "cinder-quobyte-914a6c42-1d54-4994-ac2f-8419f69dc0ee" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-quobyte-914a6c42-1d54-4994-ac2f-8419f69dc0ee" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25a4597-d804-42a2-84cf-fc8a3decb0b3]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:11 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.400s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:11 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Deleted volume successfully. Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-52d94b0e-3bae-43c4-942f-296c7df0fa00 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-4a29e256-c5b9-4234-8e81-8aa27ac7c427-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:11 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee Sep 16 16:16:11 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:11 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee" returned: 0 in 0.530s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:11 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee Sep 16 16:16:11 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:12 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-914a6c42-1d54-4994-ac2f-8419f69dc0ee" returned: 0 in 0.286s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-quobyte-914a6c42-1d54-4994-ac2f-8419f69dc0ee" released by "delete_volume" :: held 0.902s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=121,cinder:UPDATE=123,cinder:INSERT=30,cinder:DELETE=7 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Created reservations ['9a12ed61-9dbc-415c-bf89-365abe024877', 'df553993-416e-4ae2-99b1-cec74a85e7b4', 'a6d752c8-bc95-4751-a879-ad2ed0e76faf', '189580a8-3c1f-46b2-a48f-35de243c0a76'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:12 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:12 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:12 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.333s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:12 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Deleted volume successfully. Sep 16 16:16:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a66e3590-8c21-45bf-b929-ddd8ec4301e5 tempest-VolumesListAdminTestJSON-1555934331 None] Lock "cinder-914a6c42-1d54-4994-ac2f-8419f69dc0ee-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:22 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=127,cinder:SELECT=101,cinder:DELETE=8,cinder:INSERT=28 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:16:22 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Flow 'volume_create_manager' (51ed8122-034e-4927-b9b5-66c652674ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93d849e-3fb4-47da-b8bc-2334a7bff507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93d849e-3fb4-47da-b8bc-2334a7bff507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-83022146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf49538-0ade-42cc-b6be-cf160d07fb61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7d462e49464fef8409366a1b82586e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:23Z,use_quota=True,user_id='b32b94a0343c441697d5f6a5b4bbb2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4bf1cc-6efd-4e24-b187-ada3e4afabb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4bf1cc-6efd-4e24-b187-ada3e4afabb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676a7e69-a158-4f43-beb1-66270f647c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676a7e69-a158-4f43-beb1-66270f647c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf49538-0ade-42cc-b6be-cf160d07fb61', 'volume_name': 'volume-9cf49538-0ade-42cc-b6be-cf160d07fb61', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd9ebd0-0c28-45cf-9d64-79514c581bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd9ebd0-0c28-45cf-9d64-79514c581bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661d79c9-93f2-4d69-ba50-925a6c290e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:23 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Volume 9cf49538-0ade-42cc-b6be-cf160d07fb61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf49538-0ade-42cc-b6be-cf160d07fb61', 'volume_size': 1} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-83022146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf49538-0ade-42cc-b6be-cf160d07fb61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7d462e49464fef8409366a1b82586e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:23Z,use_quota=True,user_id='b32b94a0343c441697d5f6a5b4bbb2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Creating volume 9cf49538-0ade-42cc-b6be-cf160d07fb61 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:16:23 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:16:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:23 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 1073741824 Sep 16 16:16:23 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:24 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 1073741824" returned: 0 in 0.717s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:24 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 Sep 16 16:16:24 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:24 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61" returned: 0 in 0.419s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:16:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661d79c9-93f2-4d69-ba50-925a6c290e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf49538-0ade-42cc-b6be-cf160d07fb61', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8774d1a7-2588-4438-a4b5-60d8360d7c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:24 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Volume volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 (9cf49538-0ade-42cc-b6be-cf160d07fb61): created successfully Sep 16 16:16:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8774d1a7-2588-4438-a4b5-60d8360d7c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Flow 'volume_create_manager' (51ed8122-034e-4927-b9b5-66c652674ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:24 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7d73ad91-fbd0-4b18-badb-7e26cdb5cf1a tempest-VolumesTransfersV357Test-188319302 None] Created volume successfully. Sep 16 16:16:27 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9d18fe27-6e55-4992-a88d-a50a42fd3de4 tempest-VolumesTransfersV357Test-489604001 None] Transfer volume completed successfully. Sep 16 16:16:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Acquiring lock "cinder-9cf49538-0ade-42cc-b6be-cf160d07fb61-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Lock "cinder-9cf49538-0ade-42cc-b6be-cf160d07fb61-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Acquiring lock "cinder-quobyte-9cf49538-0ade-42cc-b6be-cf160d07fb61" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Lock "cinder-quobyte-9cf49538-0ade-42cc-b6be-cf160d07fb61" acquired by "delete_volume" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:28 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ffc059-9db8-45b7-bd03-9ca536e6a18c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:16:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:28 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 Sep 16 16:16:28 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:28 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61" returned: 0 in 0.528s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:29 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61 Sep 16 16:16:29 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:29 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9cf49538-0ade-42cc-b6be-cf160d07fb61" returned: 0 in 0.328s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Lock "cinder-quobyte-9cf49538-0ade-42cc-b6be-cf160d07fb61" released by "delete_volume" :: held 0.929s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Created reservations ['80929091-e00e-4493-b42c-5c2c03885111', '8b1f9f19-108b-4ab0-92f0-ee5ee5143a6c', 'a5cc52f0-88ed-494a-b8c3-717b1c12d5db', '428512fb-c4c7-4a20-9b61-21c5eea4626c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:29 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:29 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:29 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.353s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Deleted volume successfully. Sep 16 16:16:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0911e04b-9508-4ff3-926e-d0f83f1837d8 tempest-VolumesTransfersV357Test-2072995395 None] Lock "cinder-9cf49538-0ade-42cc-b6be-cf160d07fb61-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Flow 'volume_create_manager' (f50d4f54-6eb6-4aae-bf2f-9f764416ef44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9982b7d-2c61-4299-9d7e-30542efad2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9982b7d-2c61-4299-9d7e-30542efad2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-921455731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9352440-c025-4528-b992-5ce5bafe7dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aad76fab2e04965a709b0c146b39841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:30Z,use_quota=True,user_id='d4a2e896c781417bbeda4a592af7b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3f24da4-ee56-45c7-8387-8150059bbc92),volume_type_id=b3f24da4-ee56-45c7-8387-8150059bbc92)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1ccee8-9a2a-4c0b-bad9-bd4d34470a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1ccee8-9a2a-4c0b-bad9-bd4d34470a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85791897-24ee-429e-b687-4126a5bf8d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85791897-24ee-429e-b687-4126a5bf8d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9352440-c025-4528-b992-5ce5bafe7dc1', 'volume_name': 'volume-d9352440-c025-4528-b992-5ce5bafe7dc1', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494160ef-7d8a-4650-a067-783edba382f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494160ef-7d8a-4650-a067-783edba382f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d37b33e-d1f4-431c-b753-f3b212b43481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:30 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Volume d9352440-c025-4528-b992-5ce5bafe7dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9352440-c025-4528-b992-5ce5bafe7dc1', 'volume_size': 1} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-921455731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9352440-c025-4528-b992-5ce5bafe7dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aad76fab2e04965a709b0c146b39841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:30Z,use_quota=True,user_id='d4a2e896c781417bbeda4a592af7b414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3f24da4-ee56-45c7-8387-8150059bbc92),volume_type_id=b3f24da4-ee56-45c7-8387-8150059bbc92)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Creating volume d9352440-c025-4528-b992-5ce5bafe7dc1 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:16:30 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:16:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:30 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1 1073741824 Sep 16 16:16:30 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:31 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1 1073741824" returned: 0 in 0.788s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:31 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1 Sep 16 16:16:31 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:31 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1" returned: 0 in 0.492s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Flow 'volume_create_manager' (0bd92959-e2c7-41bf-84a9-4ed7d4dfad54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0094f0-35fa-4b67-9bc0-d6db47bb6db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d37b33e-d1f4-431c-b753-f3b212b43481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9352440-c025-4528-b992-5ce5bafe7dc1', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529c1108-ae86-4f48-b99e-e0e6740f5055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0094f0-35fa-4b67-9bc0-d6db47bb6db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2050822255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dfd07b-e08b-4b04-b94b-0002e07293eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7d462e49464fef8409366a1b82586e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:32Z,use_quota=True,user_id='b32b94a0343c441697d5f6a5b4bbb2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142c6354-ed54-4b94-8d4f-2f306cc95007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142c6354-ed54-4b94-8d4f-2f306cc95007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd07fe5-197e-4811-aa90-2cec2c3b38a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd07fe5-197e-4811-aa90-2cec2c3b38a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0dfd07b-e08b-4b04-b94b-0002e07293eb', 'volume_name': 'volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536911ca-f33f-42a8-8da9-9ea8a3c9bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536911ca-f33f-42a8-8da9-9ea8a3c9bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956a82d4-4021-4df9-a04f-dd19a73e797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:31 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Volume e0dfd07b-e08b-4b04-b94b-0002e07293eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb', 'volume_size': 1} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2050822255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dfd07b-e08b-4b04-b94b-0002e07293eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7d462e49464fef8409366a1b82586e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:32Z,use_quota=True,user_id='b32b94a0343c441697d5f6a5b4bbb2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Creating volume e0dfd07b-e08b-4b04-b94b-0002e07293eb {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:16:31 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:31 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Volume volume-d9352440-c025-4528-b992-5ce5bafe7dc1 (d9352440-c025-4528-b992-5ce5bafe7dc1): created successfully Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529c1108-ae86-4f48-b99e-e0e6740f5055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:31 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb 1073741824 Sep 16 16:16:31 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Flow 'volume_create_manager' (f50d4f54-6eb6-4aae-bf2f-9f764416ef44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b6609be1-aec4-4aa0-9161-9cd7b4e5e01e tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Created volume successfully. Sep 16 16:16:32 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb 1073741824" returned: 0 in 0.870s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:32 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb Sep 16 16:16:32 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-115bbe66-cb9d-4256-abf8-aa2f484dfb7a tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-115bbe66-cb9d-4256-abf8-aa2f484dfb7a tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-115bbe66-cb9d-4256-abf8-aa2f484dfb7a tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-115bbe66-cb9d-4256-abf8-aa2f484dfb7a tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-115bbe66-cb9d-4256-abf8-aa2f484dfb7a tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-115bbe66-cb9d-4256-abf8-aa2f484dfb7a tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:33 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:33 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:33 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb" returned: 0 in 0.485s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956a82d4-4021-4df9-a04f-dd19a73e797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc0cc7e-8037-4bab-905a-564cbf9a21d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Volume volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb (e0dfd07b-e08b-4b04-b94b-0002e07293eb): created successfully Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc0cc7e-8037-4bab-905a-564cbf9a21d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Flow 'volume_create_manager' (0bd92959-e2c7-41bf-84a9-4ed7d4dfad54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:33 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1f340e81-3a95-4550-965a-4efdc2885dea tempest-VolumesTransfersV357Test-188319302 None] Created volume successfully. Sep 16 16:16:33 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-115bbe66-cb9d-4256-abf8-aa2f484dfb7a tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:33 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-115bbe66-cb9d-4256-abf8-aa2f484dfb7a tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:33 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-115bbe66-cb9d-4256-abf8-aa2f484dfb7a tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Retype volume completed successfully. Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Acquiring lock "cinder-e0dfd07b-e08b-4b04-b94b-0002e07293eb-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Lock "cinder-e0dfd07b-e08b-4b04-b94b-0002e07293eb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Acquiring lock "cinder-quobyte-e0dfd07b-e08b-4b04-b94b-0002e07293eb" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Lock "cinder-quobyte-e0dfd07b-e08b-4b04-b94b-0002e07293eb" acquired by "delete_volume" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5e17f3-86e6-4f23-95a9-076384c828dd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Acquiring lock "cinder-d9352440-c025-4528-b992-5ce5bafe7dc1-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "cinder-d9352440-c025-4528-b992-5ce5bafe7dc1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:34 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb Sep 16 16:16:34 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Acquiring lock "cinder-quobyte-d9352440-c025-4528-b992-5ce5bafe7dc1" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "cinder-quobyte-d9352440-c025-4528-b992-5ce5bafe7dc1" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a16609a-d87e-4ddd-b3e4-3a517701f3de]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:34 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1 Sep 16 16:16:34 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:34 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb" returned: 0 in 0.594s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:34 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb Sep 16 16:16:34 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:35 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1" returned: 0 in 0.648s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:35 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e0dfd07b-e08b-4b04-b94b-0002e07293eb" returned: 0 in 0.357s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:35 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1 Sep 16 16:16:35 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Lock "cinder-quobyte-e0dfd07b-e08b-4b04-b94b-0002e07293eb" released by "delete_volume" :: held 1.058s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Created reservations ['9a58b7f5-7ebf-449e-bc2c-b8e41749af65', '8ecdc088-fd2d-4da0-8aca-e2e719e20cdc', '4cd018d1-baf5-426c-b1bb-f800756cf3b8', '31841358-dfed-4337-a368-80ca916548d7'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:35 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:35 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:35 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d9352440-c025-4528-b992-5ce5bafe7dc1" returned: 0 in 0.430s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "cinder-quobyte-d9352440-c025-4528-b992-5ce5bafe7dc1" released by "delete_volume" :: held 1.159s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:35 devstack cinder-volume[86255]: WARNING cinder.quota [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:16:35 devstack cinder-volume[86255]: WARNING cinder.quota [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Created reservations ['302a5bf4-aaca-4f9e-9de0-af56cb928636', '89e36959-0df1-48f9-ae6c-e9326f00db6f', '47b193c0-6613-4055-b3bb-a3a0814ee09b', 'c14cee39-f771-4632-82c2-9f402f52fdb8'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:16:35 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.360s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Deleted volume successfully. Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1a9e3d55-23c1-4ff3-abbe-5aa6b7de8a9d tempest-VolumesTransfersV357Test-2072995395 None] Lock "cinder-e0dfd07b-e08b-4b04-b94b-0002e07293eb-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:36 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:36 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:36 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.308s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:36 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Deleted volume successfully. Sep 16 16:16:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-162cd651-498a-4255-8d52-36d7885ffee9 tempest-VolumeRetypeWithoutMigrationTest-1405491716 None] Lock "cinder-d9352440-c025-4528-b992-5ce5bafe7dc1-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:16:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:16:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:41 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:16:41 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:42 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.441s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:16:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:16:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:16:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:16:45 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=33,cinder:UPDATE=36,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:16:46 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=24,cinder:UPDATE=39,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:16:53 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Flow 'volume_create_manager' (894d2ffb-f5e6-4d19-9880-df10e116e4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9d8b7a-e5aa-4269-8738-f03b44319a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9d8b7a-e5aa-4269-8738-f03b44319a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-10534150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5cd07f-7710-4bd1-9cea-d4f61495cf38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4318646c3484c74812c600884e7f777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:54Z,use_quota=True,user_id='ea27d6f7d4564bd2b8ffc81b4ac2bfd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96bd6f-2366-49ed-a5d5-e241d26905d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96bd6f-2366-49ed-a5d5-e241d26905d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed682e4-806a-4746-9aed-7d3324d6c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed682e4-806a-4746-9aed-7d3324d6c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac5cd07f-7710-4bd1-9cea-d4f61495cf38', 'volume_name': 'volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e70ca1-0430-40e3-8a23-836303f5cce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e70ca1-0430-40e3-8a23-836303f5cce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6af2033-417a-4ef3-8d22-2105166666c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:54 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Volume ac5cd07f-7710-4bd1-9cea-d4f61495cf38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38', 'volume_size': 1} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-10534150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac5cd07f-7710-4bd1-9cea-d4f61495cf38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4318646c3484c74812c600884e7f777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:54Z,use_quota=True,user_id='ea27d6f7d4564bd2b8ffc81b4ac2bfd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Creating volume ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:16:54 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:54 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 1073741824 Sep 16 16:16:54 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:54 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 1073741824" returned: 0 in 0.531s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:54 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 Sep 16 16:16:54 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:55 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38" returned: 0 in 0.330s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:16:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:16:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6af2033-417a-4ef3-8d22-2105166666c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e569675-36df-4c08-85d8-d3593d61af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:55 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Volume volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 (ac5cd07f-7710-4bd1-9cea-d4f61495cf38): created successfully Sep 16 16:16:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e569675-36df-4c08-85d8-d3593d61af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Flow 'volume_create_manager' (894d2ffb-f5e6-4d19-9880-df10e116e4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:55 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b5b18969-3e42-48c4-b692-825e095f54c2 tempest-VolumesCloneTest-1025798238 None] Created volume successfully. Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Flow 'volume_create_manager' (08d7fc96-1078-4962-a713-f5e8dc97d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4f1e48-acb2-4d20-93f7-6bf762fa97c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4f1e48-acb2-4d20-93f7-6bf762fa97c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1265413824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720baf7f-697e-439d-9a14-f2a31e900d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4318646c3484c74812c600884e7f777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:16:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ac5cd07f-7710-4bd1-9cea-d4f61495cf38,status='creating',terminated_at=None,updated_at=2026-09-16T14:16:57Z,use_quota=True,user_id='ea27d6f7d4564bd2b8ffc81b4ac2bfd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e02e64f-fbd6-41a6-b0cc-becbbb72e80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e02e64f-fbd6-41a6-b0cc-becbbb72e80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cf2d27-01d1-410b-bd3a-126c6e994e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cf2d27-01d1-410b-bd3a-126c6e994e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '720baf7f-697e-439d-9a14-f2a31e900d6d', 'volume_name': 'volume-720baf7f-697e-439d-9a14-f2a31e900d6d', 'volume_size': 2, 'source_volid': 'ac5cd07f-7710-4bd1-9cea-d4f61495cf38', 'source_volstatus': 'available'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b794107-2337-472d-8836-02cbaca0c420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b794107-2337-472d-8836-02cbaca0c420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e21446-db8d-4ae4-a319-fb82f9bd6e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:16:56 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Volume 720baf7f-697e-439d-9a14-f2a31e900d6d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-720baf7f-697e-439d-9a14-f2a31e900d6d', 'volume_size': 2, 'source_volid': 'ac5cd07f-7710-4bd1-9cea-d4f61495cf38', 'source_volstatus': 'available'} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:16:56 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Cloning volume ac5cd07f-7710-4bd1-9cea-d4f61495cf38 to volume 720baf7f-697e-439d-9a14-f2a31e900d6d Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Creating offline snapshot 4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 of volume ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd35b367-c295-4b9c-a1c7-5b73fe4b095f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:16:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:57 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 Sep 16 16:16:57 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:57 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38" returned: 0 in 0.459s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:57 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 1G Sep 16 16:16:57 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:57 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 1G" returned: 0 in 0.574s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:57 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 Sep 16 16:16:57 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:58 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68" returned: 0 in 0.299s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:58 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 is being set with open permissions: ugo+rw Sep 16 16:16:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:58 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 Sep 16 16:16:58 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:58 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68" returned: 0 in 0.246s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:59 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.info Sep 16 16:16:59 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:16:59 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Sep 16 16:16:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.info" returned: 0 in 0.276s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:16:59 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.info is being set with open permissions: ugo+rw Sep 16 16:16:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:16:59 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.info Sep 16 16:16:59 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:00 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.info" returned: 0 in 0.233s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Acquiring lock "cinder-quobyte-720baf7f-697e-439d-9a14-f2a31e900d6d" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Lock "cinder-quobyte-720baf7f-697e-439d-9a14-f2a31e900d6d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] snapshot: 4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68, volume: 720baf7f-697e-439d-9a14-f2a31e900d6d, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e087f41-9396-40f5-976f-c29d1f36fa96]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:00 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 Sep 16 16:17:00 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:00 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68" returned: 0 in 0.420s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a87db6-e908-428b-9b13-2637d5007455]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:00 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 Sep 16 16:17:00 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:00 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38" returned: 0 in 0.393s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:17:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:00 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d Sep 16 16:17:00 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Flow 'volume_create_manager' (e45ed932-59af-4727-b4f5-73f755b9f7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52141d21-26ba-4f6e-98ea-7dd4d1b5e153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52141d21-26ba-4f6e-98ea-7dd4d1b5e153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-802508656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7575513-903e-46fd-8751-85f633b9d7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb0714800f4d71b1b7f12f824d4af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:06Z,use_quota=True,user_id='f3994cb998c34c62994120211bfc24f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993bb2d6-51ac-4901-ac93-e4786a680c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993bb2d6-51ac-4901-ac93-e4786a680c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889ee451-6447-41c4-a611-20facd1b75e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889ee451-6447-41c4-a611-20facd1b75e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7575513-903e-46fd-8751-85f633b9d7d8', 'volume_name': 'volume-f7575513-903e-46fd-8751-85f633b9d7d8', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745abe04-c9ee-4ef3-b3a3-16c68ce53566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745abe04-c9ee-4ef3-b3a3-16c68ce53566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9f175d-0900-4c40-837d-015841f7b1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:05 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Volume f7575513-903e-46fd-8751-85f633b9d7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7575513-903e-46fd-8751-85f633b9d7d8', 'volume_size': 1} Sep 16 16:17:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Flow 'volume_create_manager' (c73a9522-cd8d-4bba-951b-7f3d3d5d91cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0de84a8-ba97-4c2b-b0c4-1a06e9c04a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0de84a8-ba97-4c2b-b0c4-1a06e9c04a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1148547422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6ec4a4-491d-47e6-8df6-9614ee345856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9cd5d2cb3474da854f19018923cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:08Z,use_quota=True,user_id='9a78072b4f4f40ac9bb27804951dbb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871335cc-f0d7-43f5-9d18-16373e5a1edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871335cc-f0d7-43f5-9d18-16373e5a1edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18098f02-cfa4-4e0e-81bd-355e36e746a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18098f02-cfa4-4e0e-81bd-355e36e746a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6ec4a4-491d-47e6-8df6-9614ee345856', 'volume_name': 'volume-eb6ec4a4-491d-47e6-8df6-9614ee345856', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6f0246-8fb8-4768-a70a-691f1a76efc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6f0246-8fb8-4768-a70a-691f1a76efc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f05007-4035-4b93-b58d-b2ebec9dea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:08 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Volume eb6ec4a4-491d-47e6-8df6-9614ee345856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6ec4a4-491d-47e6-8df6-9614ee345856', 'volume_size': 1} Sep 16 16:17:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:09 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d" returned: 0 in 8.150s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38, size 1024.00 MB, duration 8.15 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:17:09 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Converted 1024.00 MB image at 125.62 MB/s Sep 16 16:17:09 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d is being set with open permissions: ugo+rw Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:09 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d Sep 16 16:17:09 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:09 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d" returned: 0 in 0.276s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Lock "cinder-quobyte-720baf7f-697e-439d-9a14-f2a31e900d6d" released by "_copy_volume_from_snapshot" :: held 9.321s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Acquiring lock "cinder-quobyte-4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Lock "cinder-quobyte-4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Deleting offline snapshot 4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 of volume ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] snapshot_file for this snap is: volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f73104-6cea-41dc-8b44-55ba61032968]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:09 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 Sep 16 16:17:09 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:09 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68" returned: 0 in 0.461s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e49629-0281-440a-9beb-c8fbbe720031]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:10 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 Sep 16 16:17:10 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:10 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38" returned: 0 in 0.571s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:10 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 Sep 16 16:17:10 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:11 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68" returned: 0 in 0.683s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:11 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68 Sep 16 16:17:11 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:11 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38.4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68" returned: 0 in 0.483s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Lock "cinder-quobyte-4ecaa755-54d9-4da9-8a5b-8d1f9a87ea68" released by "_delete_snapshot" :: held 2.374s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-802508656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7575513-903e-46fd-8751-85f633b9d7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb0714800f4d71b1b7f12f824d4af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:06Z,use_quota=True,user_id='f3994cb998c34c62994120211bfc24f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Creating volume f7575513-903e-46fd-8751-85f633b9d7d8 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:17:11 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e21446-db8d-4ae4-a319-fb82f9bd6e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720baf7f-697e-439d-9a14-f2a31e900d6d', 'volume_size': 2, 'source_volid': 'ac5cd07f-7710-4bd1-9cea-d4f61495cf38', 'source_volstatus': 'available'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:11 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 1073741824 Sep 16 16:17:11 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d60e88-770c-4744-8e34-3f783fa8bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:11 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Volume volume-720baf7f-697e-439d-9a14-f2a31e900d6d (720baf7f-697e-439d-9a14-f2a31e900d6d): created successfully Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d60e88-770c-4744-8e34-3f783fa8bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Flow 'volume_create_manager' (08d7fc96-1078-4962-a713-f5e8dc97d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:17:11 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b2a315bc-923d-4f31-9fd3-f17ebb4d37c3 tempest-VolumesCloneTest-1025798238 None] Created volume successfully. Sep 16 16:17:12 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 1073741824" returned: 0 in 0.729s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:12 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 Sep 16 16:17:12 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:12 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8" returned: 0 in 0.302s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.678s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1148547422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6ec4a4-491d-47e6-8df6-9614ee345856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd9cd5d2cb3474da854f19018923cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:08Z,use_quota=True,user_id='9a78072b4f4f40ac9bb27804951dbb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Creating volume eb6ec4a4-491d-47e6-8df6-9614ee345856 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:17:12 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9f175d-0900-4c40-837d-015841f7b1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7575513-903e-46fd-8751-85f633b9d7d8', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:12 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 1073741824 Sep 16 16:17:12 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf7eeae-aa4b-44bc-b891-c5ed81c4a420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Acquiring lock "cinder-720baf7f-697e-439d-9a14-f2a31e900d6d-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:13 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Volume volume-f7575513-903e-46fd-8751-85f633b9d7d8 (f7575513-903e-46fd-8751-85f633b9d7d8): created successfully Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf7eeae-aa4b-44bc-b891-c5ed81c4a420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Flow 'volume_create_manager' (e45ed932-59af-4727-b4f5-73f755b9f7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Lock "cinder-720baf7f-697e-439d-9a14-f2a31e900d6d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:13 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-25ffae52-6232-4a83-ac7f-ef80e086f101 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Created volume successfully. Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Acquiring lock "cinder-quobyte-720baf7f-697e-439d-9a14-f2a31e900d6d" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Lock "cinder-quobyte-720baf7f-697e-439d-9a14-f2a31e900d6d" acquired by "delete_volume" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe7c01c-a1a9-4c4c-ba53-5afa9f8ce799]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:13 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d Sep 16 16:17:13 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:13 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 1073741824" returned: 0 in 0.676s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:13 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d" returned: 0 in 0.506s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:13 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 Sep 16 16:17:13 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:13 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d Sep 16 16:17:13 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:13 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856" returned: 0 in 0.275s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.338s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f05007-4035-4b93-b58d-b2ebec9dea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6ec4a4-491d-47e6-8df6-9614ee345856', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a52169-3e21-49e0-a87a-ffb05856b1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Creating offline snapshot 23d143b0-5f99-44c1-ba1b-1c254411a6c6 of volume f7575513-903e-46fd-8751-85f633b9d7d8 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:17:14 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Volume volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 (eb6ec4a4-491d-47e6-8df6-9614ee345856): created successfully Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4a52169-3e21-49e0-a87a-ffb05856b1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Flow 'volume_create_manager' (c73a9522-cd8d-4bba-951b-7f3d3d5d91cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[72812fef-0796-4d98-afe4-1d72be75b433]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:14 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-720baf7f-697e-439d-9a14-f2a31e900d6d" returned: 0 in 0.393s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e802035f-1291-447b-b9a4-c3524c20f5f5 tempest-AttachVolumeShelveTestJSON-156447711 None] Created volume successfully. Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Lock "cinder-quobyte-720baf7f-697e-439d-9a14-f2a31e900d6d" released by "delete_volume" :: held 0.995s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Created reservations ['955360ab-1eaa-4dc0-b5c7-4bf818d6e0f9', 'b218d5c3-5be7-49dc-8d25-cc53db703289', '2a89999b-e3b5-45b3-b82f-319c0ddd43a8', 'd5b02a4c-62e5-4b1a-9a9c-6dbaba915587'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:17:14 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 Sep 16 16:17:14 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:14 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:17:14 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:14 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8" returned: 0 in 0.646s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:14 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 1G Sep 16 16:17:14 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:14 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.397s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:17:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Deleted volume successfully. Sep 16 16:17:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fbca0d3b-3e60-4810-a642-295ba35eb8fc tempest-VolumesCloneTest-1025798238 None] Lock "cinder-720baf7f-697e-439d-9a14-f2a31e900d6d-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:15 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 1G" returned: 0 in 0.705s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7575513-903e-46fd-8751-85f633b9d7d8 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:15 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7575513-903e-46fd-8751-85f633b9d7d8 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 Sep 16 16:17:15 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Acquiring lock "cinder-ac5cd07f-7710-4bd1-9cea-d4f61495cf38-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Lock "cinder-ac5cd07f-7710-4bd1-9cea-d4f61495cf38-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Acquiring lock "cinder-quobyte-ac5cd07f-7710-4bd1-9cea-d4f61495cf38" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Lock "cinder-quobyte-ac5cd07f-7710-4bd1-9cea-d4f61495cf38" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:15 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba3843-9ec5-4071-915f-de315cdf1530]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:15 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 Sep 16 16:17:15 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:16 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Flow 'volume_create_manager' (4347c1f5-5de1-4c72-9397-b54b84674e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038f03b0-89b9-45c1-b013-0d4a11402e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7575513-903e-46fd-8751-85f633b9d7d8 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6" returned: 0 in 0.640s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:16 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 is being set with open permissions: ugo+rw Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038f03b0-89b9-45c1-b013-0d4a11402e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1641822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44c7c017ccb4554b0b549f808ca3b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:16Z,use_quota=True,user_id='7f1ecc475f7349edba7ec9d4778b1c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b208d58d-d48c-4fed-90ef-9f80e94b0124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b208d58d-d48c-4fed-90ef-9f80e94b0124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde5bba4-8e72-4c04-b4ad-3e07608dceff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde5bba4-8e72-4c04-b4ad-3e07608dceff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47', 'volume_name': 'volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:16 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 Sep 16 16:17:16 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead1d893-98ba-444a-aaff-2f7f15479af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead1d893-98ba-444a-aaff-2f7f15479af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca507409-6f84-4b53-af17-895a0c78f124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:16 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Volume e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47', 'volume_size': 1} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:16 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38" returned: 0 in 0.696s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:16 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38 Sep 16 16:17:16 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:16 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6" returned: 0 in 0.436s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:16 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.info Sep 16 16:17:16 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:16 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ac5cd07f-7710-4bd1-9cea-d4f61495cf38" returned: 0 in 0.484s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Lock "cinder-quobyte-ac5cd07f-7710-4bd1-9cea-d4f61495cf38" released by "delete_volume" :: held 1.305s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:16 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.info" returned: 0 in 0.409s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:16 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.info is being set with open permissions: ugo+rw Sep 16 16:17:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:16 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.info Sep 16 16:17:16 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Created reservations ['2f89ced7-7de3-4771-8aaf-84b788ce8714', '4f0205c4-3b28-489c-a049-6d79dc276249', 'a90f1953-360a-4412-a513-a037f88706aa', 'dd440f98-a115-478a-be58-cc3249b077b3'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:17 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:17:17 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:17 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.info" returned: 0 in 0.325s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.356s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1641822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e44c7c017ccb4554b0b549f808ca3b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:16Z,use_quota=True,user_id='7f1ecc475f7349edba7ec9d4778b1c28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Creating volume e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:17:17 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:17 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 1073741824 Sep 16 16:17:17 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:17 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4dcdb855-89ad-4859-999a-e0c14587cc79 tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Create snapshot completed successfully Sep 16 16:17:17 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.333s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:17:17 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Deleted volume successfully. Sep 16 16:17:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a3d70ec3-eea7-4a6a-b4e0-2bb241fb5869 tempest-VolumesCloneTest-1025798238 None] Lock "cinder-ac5cd07f-7710-4bd1-9cea-d4f61495cf38-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:18 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 1073741824" returned: 0 in 0.665s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:18 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 Sep 16 16:17:18 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:18 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47" returned: 0 in 0.442s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca507409-6f84-4b53-af17-895a0c78f124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96aa06a-5729-4471-aea0-3aa4f6cbf921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:18 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Volume volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 (e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47): created successfully Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96aa06a-5729-4471-aea0-3aa4f6cbf921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Flow 'volume_create_manager' (4347c1f5-5de1-4c72-9397-b54b84674e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:17:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7de6df69-00b6-4404-a60c-bba7e17128a2 tempest-TestMinimumBasicScenario-549720578 None] Created volume successfully. Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Acquiring lock "cinder-23d143b0-5f99-44c1-ba1b-1c254411a6c6-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-23d143b0-5f99-44c1-ba1b-1c254411a6c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Acquiring lock "cinder-quobyte-f7575513-903e-46fd-8751-85f633b9d7d8" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-quobyte-f7575513-903e-46fd-8751-85f633b9d7d8" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Acquiring lock "cinder-quobyte-23d143b0-5f99-44c1-ba1b-1c254411a6c6" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-quobyte-23d143b0-5f99-44c1-ba1b-1c254411a6c6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Deleting offline snapshot 23d143b0-5f99-44c1-ba1b-1c254411a6c6 of volume f7575513-903e-46fd-8751-85f633b9d7d8 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] snapshot_file for this snap is: volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd58427-c85c-4472-a45f-7da0ecf35195]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:19 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 Sep 16 16:17:19 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:19 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6" returned: 0 in 0.803s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7575513-903e-46fd-8751-85f633b9d7d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:17:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9472cd-2e72-4d52-a8d9-370a732257d9]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:20 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 Sep 16 16:17:20 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:20 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8" returned: 0 in 0.823s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:20 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 Sep 16 16:17:20 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-334a3783-8dd6-4710-baeb-4c0232f57471 req-929244bb-b3e1-4a41-b668-56c0b4bbb936 tempest-TestMinimumBasicScenario-549720578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-334a3783-8dd6-4710-baeb-4c0232f57471 req-929244bb-b3e1-4a41-b668-56c0b4bbb936 tempest-TestMinimumBasicScenario-549720578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-334a3783-8dd6-4710-baeb-4c0232f57471 req-929244bb-b3e1-4a41-b668-56c0b4bbb936 tempest-TestMinimumBasicScenario-549720578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:21 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6" returned: 0 in 0.706s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:21 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6 Sep 16 16:17:21 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-334a3783-8dd6-4710-baeb-4c0232f57471 req-929244bb-b3e1-4a41-b668-56c0b4bbb936 tempest-TestMinimumBasicScenario-549720578 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04187743-647c-420f-9f01-60c270f3213f', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:17:21 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-334a3783-8dd6-4710-baeb-4c0232f57471 req-929244bb-b3e1-4a41-b668-56c0b4bbb936 tempest-TestMinimumBasicScenario-549720578 None] attachment_update completed successfully. Sep 16 16:17:21 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8.23d143b0-5f99-44c1-ba1b-1c254411a6c6" returned: 0 in 0.654s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-quobyte-23d143b0-5f99-44c1-ba1b-1c254411a6c6" released by "_delete_snapshot" :: held 3.196s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-quobyte-f7575513-903e-46fd-8751-85f633b9d7d8" released by "delete_snapshot" :: held 3.242s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:22 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Created reservations ['b25eb7d6-9391-4955-b332-8ed9c234d85e', 'e13aa7a8-0591-4eff-ab47-f026077c7f7f', 'c9762693-c906-4f65-88cf-2cc2e7fc9d43', '7a0c7821-df76-43b2-a461-9756c41d825b'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:17:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Delete snapshot completed successfully. Sep 16 16:17:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-176c2529-eb09-4a0b-9dc1-c0676e4326ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-23d143b0-5f99-44c1-ba1b-1c254411a6c6-delete_snapshot" released by "delete_snapshot" :: held 3.553s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Acquiring lock "cinder-f7575513-903e-46fd-8751-85f633b9d7d8-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-f7575513-903e-46fd-8751-85f633b9d7d8-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Acquiring lock "cinder-quobyte-f7575513-903e-46fd-8751-85f633b9d7d8" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-quobyte-f7575513-903e-46fd-8751-85f633b9d7d8" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:23 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[35abe689-d95d-4bb3-bab9-e4b73e124de2]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:23 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 Sep 16 16:17:23 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:24 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8" returned: 0 in 0.548s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:24 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8 Sep 16 16:17:24 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:24 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7575513-903e-46fd-8751-85f633b9d7d8" returned: 0 in 0.502s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-quobyte-f7575513-903e-46fd-8751-85f633b9d7d8" released by "delete_volume" :: held 1.144s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:24 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Created reservations ['e23d9801-3fae-4bbf-9f37-c3527da0350e', 'baad0622-2bad-478f-9a93-ccdd734ba0b3', 'c200d351-4e13-4cec-9a4f-0112ec4015c8', '2b44b5ce-b242-498d-8091-000d1dfa64a5'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:17:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:25 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:17:25 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:25 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.412s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:25 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:17:25 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Deleted volume successfully. Sep 16 16:17:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-14ce5e9a-5c98-44c7-9e99-de081b1c9d0a tempest-VolumeSnapshotQuotasNegativeTestJSON-1920221666 None] Lock "cinder-f7575513-903e-46fd-8751-85f633b9d7d8-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-e20ce2a6-8a7b-4985-bb98-26c5f00eb969 req-7214e9ae-8a62-423d-8bc3-a8593f68c22c tempest-AttachVolumeShelveTestJSON-156447711 None] No connector for attachment f344cbc4-d287-42b5-964d-9dd10f8bd0cb; skipping storage backend terminate_connection call. {{(pid=86255) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 16 16:17:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-e20ce2a6-8a7b-4985-bb98-26c5f00eb969 req-7214e9ae-8a62-423d-8bc3-a8593f68c22c tempest-AttachVolumeShelveTestJSON-156447711 None] Deleting attachment f344cbc4-d287-42b5-964d-9dd10f8bd0cb. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Flow 'volume_create_manager' (b686ee1a-6250-42f0-928d-b9a71c4d208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f6d4ca-419d-4703-90fd-3ea410e5fc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f6d4ca-419d-4703-90fd-3ea410e5fc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1269965993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296ffc47-a233-4bfa-848d-b7c0aab5444c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf6218bd2944a83bc33e06b170c2b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:35Z,use_quota=True,user_id='c501b2d918c245108cb0ada84acd933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad63c955-efb9-4f04-afc1-8d63b4ddaef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad63c955-efb9-4f04-afc1-8d63b4ddaef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d7913b-f229-4013-8a67-133d2430f52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d7913b-f229-4013-8a67-133d2430f52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296ffc47-a233-4bfa-848d-b7c0aab5444c', 'volume_name': 'volume-296ffc47-a233-4bfa-848d-b7c0aab5444c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c35bb50-4cef-4ea1-9f41-74e1887de5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c35bb50-4cef-4ea1-9f41-74e1887de5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a0a53c-7906-4cbd-9c48-dce224b3d284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Volume 296ffc47-a233-4bfa-848d-b7c0aab5444c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296ffc47-a233-4bfa-848d-b7c0aab5444c', 'volume_size': 1} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1269965993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296ffc47-a233-4bfa-848d-b7c0aab5444c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf6218bd2944a83bc33e06b170c2b79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:17:35Z,use_quota=True,user_id='c501b2d918c245108cb0ada84acd933c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Creating volume 296ffc47-a233-4bfa-848d-b7c0aab5444c {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:17:35 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:17:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:35 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c 1073741824 Sep 16 16:17:35 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:36 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c 1073741824" returned: 0 in 0.848s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:36 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c Sep 16 16:17:36 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:36 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c" returned: 0 in 0.323s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:17:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a0a53c-7906-4cbd-9c48-dce224b3d284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296ffc47-a233-4bfa-848d-b7c0aab5444c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1001e649-ed89-4bbd-807b-0565a2fcf0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:17:36 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Volume volume-296ffc47-a233-4bfa-848d-b7c0aab5444c (296ffc47-a233-4bfa-848d-b7c0aab5444c): created successfully Sep 16 16:17:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1001e649-ed89-4bbd-807b-0565a2fcf0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:17:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Flow 'volume_create_manager' (b686ee1a-6250-42f0-928d-b9a71c4d208a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:17:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ea81d581-0cbd-4238-9c5c-1f0948bc11b9 tempest-VolumesMetadataTest-1065145429 None] Created volume successfully. Sep 16 16:17:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Acquiring lock "cinder-296ffc47-a233-4bfa-848d-b7c0aab5444c-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Lock "cinder-296ffc47-a233-4bfa-848d-b7c0aab5444c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Acquiring lock "cinder-quobyte-296ffc47-a233-4bfa-848d-b7c0aab5444c" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:17:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Lock "cinder-quobyte-296ffc47-a233-4bfa-848d-b7c0aab5444c" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:17:38 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6501d4-6c2b-443d-abfe-63ed76a60aa5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:17:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:38 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c Sep 16 16:17:38 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:39 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c" returned: 0 in 0.634s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:39 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c Sep 16 16:17:39 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:39 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-296ffc47-a233-4bfa-848d-b7c0aab5444c" returned: 0 in 0.346s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Lock "cinder-quobyte-296ffc47-a233-4bfa-848d-b7c0aab5444c" released by "delete_volume" :: held 1.056s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Created reservations ['17c09f08-865e-49b5-9260-8605b1d9c574', '3ed9bdfe-452f-45b0-bae1-e3a76f35a0d8', 'c60890d8-8597-4c08-9b1e-2ca404c98e68', 'f8e57c95-4b03-4433-b30d-41796c649c56'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:39 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:17:39 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:40 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.303s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:40 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:17:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Deleted volume successfully. Sep 16 16:17:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-28ca9fa0-234e-4d72-bcec-2c1da74d21b4 tempest-VolumesMetadataTest-1065145429 None] Lock "cinder-296ffc47-a233-4bfa-848d-b7c0aab5444c-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:17:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:17:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:17:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:17:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:17:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:17:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:17:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:17:41 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:17:41 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:17:42 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 16 16:17:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.674s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:17:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:17:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:17:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:17:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:17:49 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=44,cinder:UPDATE=59,cinder:DELETE=3,cinder:INSERT=15 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:17:50 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=60,cinder:INSERT=14,cinder:UPDATE=62,cinder:DELETE=8 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Flow 'volume_create_manager' (3aced554-2ae8-4d7c-8b8d-e1a048401902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b266cb3a-b51d-4166-9a4e-08187818f02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b266cb3a-b51d-4166-9a4e-08187818f02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2132488255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53340cf5-e8b9-4b26-9454-1c1e4f0596b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373877a073b7454aa4ed46d9ed53871d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:05Z,use_quota=True,user_id='2c4d28f3ef5f4702b49105061937189a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6059869d-d00e-4c08-8883-499838625934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6059869d-d00e-4c08-8883-499838625934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5095811-531c-4e31-bdce-5cebc4b8aa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5095811-531c-4e31-bdce-5cebc4b8aa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53340cf5-e8b9-4b26-9454-1c1e4f0596b3', 'volume_name': 'volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4c5873-5004-4b96-8fd8-182d9597c466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4c5873-5004-4b96-8fd8-182d9597c466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c738745f-fcec-4a2f-8745-0f42e08c079d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:05 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Volume 53340cf5-e8b9-4b26-9454-1c1e4f0596b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3', 'volume_size': 1} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2132488255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53340cf5-e8b9-4b26-9454-1c1e4f0596b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373877a073b7454aa4ed46d9ed53871d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:05Z,use_quota=True,user_id='2c4d28f3ef5f4702b49105061937189a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Creating volume 53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:18:05 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:18:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:05 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 1073741824 Sep 16 16:18:05 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:06 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 1073741824" returned: 0 in 0.486s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:06 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 Sep 16 16:18:06 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:06 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" returned: 0 in 0.344s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:18:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c738745f-fcec-4a2f-8745-0f42e08c079d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a0f305-3dfd-42d7-856c-7368c1f83739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Volume volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 (53340cf5-e8b9-4b26-9454-1c1e4f0596b3): created successfully Sep 16 16:18:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a0f305-3dfd-42d7-856c-7368c1f83739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Flow 'volume_create_manager' (3aced554-2ae8-4d7c-8b8d-e1a048401902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:18:06 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-55df8aa1-b4e7-423b-94c1-0f6f7ee8f6e7 tempest-TestStampPattern-840214300 None] Created volume successfully. Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Flow 'volume_create_manager' (db5dd91c-e964-42a0-a2a1-6ef44b034017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb2fe56-8ea7-4b36-87b7-d7b2e48ff76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb2fe56-8ea7-4b36-87b7-d7b2e48ff76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1780022791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab7bda0-00ed-435e-a0d6-e9f3de89e418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfa517dc8704f09880a86023a2742af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:08Z,use_quota=True,user_id='8f1c43e6fb174f709bb74691d569292c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f207535-dfc3-4587-884a-c143c69c50b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f207535-dfc3-4587-884a-c143c69c50b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2143b062-c050-48b3-b665-5e282b5ce3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2143b062-c050-48b3-b665-5e282b5ce3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab7bda0-00ed-435e-a0d6-e9f3de89e418', 'volume_name': 'volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56507d86-b2b4-4620-a857-22ffa563b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56507d86-b2b4-4620-a857-22ffa563b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5210a3fc-3c53-42b5-a453-2bfc9fa05e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:08 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Volume cab7bda0-00ed-435e-a0d6-e9f3de89e418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418', 'volume_size': 1} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1780022791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab7bda0-00ed-435e-a0d6-e9f3de89e418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfa517dc8704f09880a86023a2742af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:08Z,use_quota=True,user_id='8f1c43e6fb174f709bb74691d569292c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Creating volume cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:18:08 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:18:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:08 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 1073741824 Sep 16 16:18:08 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:09 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 1073741824" returned: 0 in 0.795s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:09 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 Sep 16 16:18:09 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:09 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418" returned: 0 in 0.314s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:18:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5210a3fc-3c53-42b5-a453-2bfc9fa05e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834bc672-5644-41d8-adb8-e0f7db24c1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Volume volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 (cab7bda0-00ed-435e-a0d6-e9f3de89e418): created successfully Sep 16 16:18:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834bc672-5644-41d8-adb8-e0f7db24c1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Flow 'volume_create_manager' (db5dd91c-e964-42a0-a2a1-6ef44b034017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:18:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-feddf26c-458d-403b-bc5b-a9cfa257b7d7 tempest-VolumesActionsTest-900816444 None] Created volume successfully. Sep 16 16:18:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-f7dde7c6-210d-426e-a8e5-ae036399a3fb req-a2367fc6-1e23-424d-9107-de20337fafaf tempest-TestMinimumBasicScenario-549720578 None] Terminate volume connection completed successfully. Sep 16 16:18:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-f7dde7c6-210d-426e-a8e5-ae036399a3fb req-a2367fc6-1e23-424d-9107-de20337fafaf tempest-TestMinimumBasicScenario-549720578 None] Deleting attachment 04187743-647c-420f-9f01-60c270f3213f. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:18:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Acquiring lock "cinder-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Lock "cinder-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Acquiring lock "cinder-quobyte-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Lock "cinder-quobyte-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef79b5df-67fb-455f-af7e-ab305a9f6438]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:18:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:20 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 Sep 16 16:18:20 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:20 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47" returned: 0 in 0.657s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:20 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47 Sep 16 16:18:20 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:21 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47" returned: 0 in 0.576s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Lock "cinder-quobyte-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47" released by "delete_volume" :: held 1.309s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:18:21 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Created reservations ['4d163058-6d75-40ad-8efc-f1094fd84693', '6309a087-8d20-4d84-8709-3f157179cebe', '6a9aea6b-9fd5-4f35-8951-013d790f7087', '0dafa91e-8410-4e96-a5f0-e83046256c82'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:18:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:18:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:18:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:21 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:18:21 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:22 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.906s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:22 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:18:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Deleted volume successfully. Sep 16 16:18:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f44b307b-3794-49af-8dd7-0e126fcdfdce tempest-TestMinimumBasicScenario-549720578 None] Lock "cinder-e7ead4d8-7b3a-45d6-9090-f2ed0bd05a47-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:18:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Acquiring lock "cinder-eb6ec4a4-491d-47e6-8df6-9614ee345856-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "cinder-eb6ec4a4-491d-47e6-8df6-9614ee345856-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Acquiring lock "cinder-quobyte-eb6ec4a4-491d-47e6-8df6-9614ee345856" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "cinder-quobyte-eb6ec4a4-491d-47e6-8df6-9614ee345856" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:26 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da46a86-faae-4ece-ad95-f472b39f2e3f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:18:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:26 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 Sep 16 16:18:27 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:27 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856" returned: 0 in 0.395s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:27 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856 Sep 16 16:18:27 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:27 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eb6ec4a4-491d-47e6-8df6-9614ee345856" returned: 0 in 0.286s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "cinder-quobyte-eb6ec4a4-491d-47e6-8df6-9614ee345856" released by "delete_volume" :: held 0.758s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Created reservations ['0c12df15-95d3-4fcd-af01-ac8df1ac903c', '8a819907-ea1f-479a-9a30-b78fcd042608', 'b7a0f2e4-c8d6-421d-8c82-655ae8231d61', '851d9b6e-c0e4-4959-8497-057429c76ca6'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-57c2dd26-081b-44f0-86ac-22334a141fad tempest-VolumesActionsTest-900816444 None] Acquiring lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418" by "attach_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:27 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:18:27 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-57c2dd26-081b-44f0-86ac-22334a141fad tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418" acquired by "attach_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:27 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-57c2dd26-081b-44f0-86ac-22334a141fad tempest-VolumesActionsTest-900816444 None] Attaching volume cab7bda0-00ed-435e-a0d6-e9f3de89e418 to instance 4ec57038-0ece-4443-ba53-6393c286ab89 at mountpoint /dev/vdb on host None. Sep 16 16:18:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-57c2dd26-081b-44f0-86ac-22334a141fad tempest-VolumesActionsTest-900816444 None] Attach volume completed successfully. Sep 16 16:18:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-57c2dd26-081b-44f0-86ac-22334a141fad tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418" released by "attach_volume" :: held 0.215s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:18:28 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.461s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:28 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:18:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4bbc136c-c06a-45cb-91f2-a2487fd0eab4 tempest-VolumesActionsTest-900816444 None] Acquiring lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418-detach_volume" by "detach_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Deleted volume successfully. Sep 16 16:18:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4bbc136c-c06a-45cb-91f2-a2487fd0eab4 tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4bbc136c-c06a-45cb-91f2-a2487fd0eab4 tempest-VolumesActionsTest-900816444 None] Detaching volume cab7bda0-00ed-435e-a0d6-e9f3de89e418 from instance 4ec57038-0ece-4443-ba53-6393c286ab89. Sep 16 16:18:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d3051fb7-772d-42d1-8771-6a550b8a397d tempest-AttachVolumeShelveTestJSON-156447711 None] Lock "cinder-eb6ec4a4-491d-47e6-8df6-9614ee345856-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:18:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4bbc136c-c06a-45cb-91f2-a2487fd0eab4 tempest-VolumesActionsTest-900816444 None] Detach volume completed successfully. Sep 16 16:18:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4bbc136c-c06a-45cb-91f2-a2487fd0eab4 tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418-detach_volume" released by "detach_volume" :: held 0.162s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:18:38 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:18:38 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=29,cinder:SELECT=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:18:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-2d7d2a71-1860-4306-b6ae-488e510e230c req-24694405-e75b-439b-bd56-daec53fb6a99 tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-2d7d2a71-1860-4306-b6ae-488e510e230c req-24694405-e75b-439b-bd56-daec53fb6a99 tempest-TestStampPattern-840214300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-2d7d2a71-1860-4306-b6ae-488e510e230c req-24694405-e75b-439b-bd56-daec53fb6a99 tempest-TestStampPattern-840214300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-2d7d2a71-1860-4306-b6ae-488e510e230c req-24694405-e75b-439b-bd56-daec53fb6a99 tempest-TestStampPattern-840214300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29b25e7c-0af8-43d1-bdae-05a9d5e76ac4', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:18:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-2d7d2a71-1860-4306-b6ae-488e510e230c req-24694405-e75b-439b-bd56-daec53fb6a99 tempest-TestStampPattern-840214300 None] attachment_update completed successfully. Sep 16 16:18:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ec27cf1b-c765-40c6-836d-45d9d5fe7729 tempest-GroupSnapshotsTest-914175389 None] Group tempest-GroupSnapshotsTest-Group-719542903: creating Sep 16 16:18:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ec27cf1b-c765-40c6-836d-45d9d5fe7729 tempest-GroupSnapshotsTest-914175389 None] Group tempest-GroupSnapshotsTest-Group-719542903: created successfully Sep 16 16:18:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ec27cf1b-c765-40c6-836d-45d9d5fe7729 tempest-GroupSnapshotsTest-914175389 None] Create group completed successfully. Sep 16 16:18:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:18:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:18:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:18:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:41 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:18:41 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:42 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.565s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:18:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:18:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:18:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Flow 'volume_create_manager' (bac5e5a5-8d40-4099-9346-a4ea39662ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adbfe77-ebab-4613-bf73-322313b09ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adbfe77-ebab-4613-bf73-322313b09ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1432589944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e830541-561f-4c9a-a436-a66f6151025a,host='devstack@QuobyteHD#QuobyteHD',id=988d32bf-6259-474a-b044-f0555781427d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161f0292b69a43069ed72006b4c99da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:43Z,use_quota=True,user_id='c3e3444499c34473a17f3e4bac2e4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93399954-0dcb-47fa-8d8a-cdebcf698e53),volume_type_id=93399954-0dcb-47fa-8d8a-cdebcf698e53)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4d301d-3edf-4cce-9232-6c06fdfc3d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4d301d-3edf-4cce-9232-6c06fdfc3d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580ec92f-708e-4fdd-aecb-3b6a0ddf3d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580ec92f-708e-4fdd-aecb-3b6a0ddf3d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988d32bf-6259-474a-b044-f0555781427d', 'volume_name': 'volume-988d32bf-6259-474a-b044-f0555781427d', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e34650b-b1b3-49ff-a1e6-af6084e1883b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e34650b-b1b3-49ff-a1e6-af6084e1883b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62b671b-8589-41ff-835a-e0ea44623600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:43 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Volume 988d32bf-6259-474a-b044-f0555781427d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988d32bf-6259-474a-b044-f0555781427d', 'volume_size': 1} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4e830541-561f-4c9a-a436-a66f6151025a,created_at=2026-09-16T14:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1432589944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4e830541-561f-4c9a-a436-a66f6151025a,host='devstack@QuobyteHD#QuobyteHD',id=988d32bf-6259-474a-b044-f0555781427d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161f0292b69a43069ed72006b4c99da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:18:43Z,use_quota=True,user_id='c3e3444499c34473a17f3e4bac2e4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93399954-0dcb-47fa-8d8a-cdebcf698e53),volume_type_id=93399954-0dcb-47fa-8d8a-cdebcf698e53)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Creating volume 988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:18:43 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:18:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:43 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d 1073741824 Sep 16 16:18:43 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:44 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d 1073741824" returned: 0 in 0.915s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:44 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d Sep 16 16:18:44 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:44 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d" returned: 0 in 0.351s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:18:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62b671b-8589-41ff-835a-e0ea44623600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988d32bf-6259-474a-b044-f0555781427d', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0038c53-9ed3-4542-ab6e-117afc8d209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:18:45 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Volume volume-988d32bf-6259-474a-b044-f0555781427d (988d32bf-6259-474a-b044-f0555781427d): created successfully Sep 16 16:18:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0038c53-9ed3-4542-ab6e-117afc8d209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:18:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Flow 'volume_create_manager' (bac5e5a5-8d40-4099-9346-a4ea39662ebd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:18:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c0b47499-6233-4ce5-b924-f3b80ea2b043 tempest-GroupSnapshotsTest-914175389 None] Created volume successfully. Sep 16 16:18:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-484eb359-44af-4537-b367-282871d6fbf3 tempest-VolumesActionsTest-900816444 None] Acquiring lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418" by "attach_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-484eb359-44af-4537-b367-282871d6fbf3 tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418" acquired by "attach_volume" :: waited 0.066s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-484eb359-44af-4537-b367-282871d6fbf3 tempest-VolumesActionsTest-900816444 None] Attaching volume cab7bda0-00ed-435e-a0d6-e9f3de89e418 to instance b923982c-9833-4a7b-8255-668b4fc17f38 at mountpoint /dev/vdb on host None. Sep 16 16:18:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] GroupSnapshot abeba3d2-e429-40a8-88c4-1c713284b34b: creating. Sep 16 16:18:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-484eb359-44af-4537-b367-282871d6fbf3 tempest-VolumesActionsTest-900816444 None] Attach volume completed successfully. Sep 16 16:18:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-484eb359-44af-4537-b367-282871d6fbf3 tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418" released by "attach_volume" :: held 0.226s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:18:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Group snapshot abeba3d2-e429-40a8-88c4-1c713284b34b: creating. {{(pid=86255) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 16 16:18:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Creating offline snapshot 509a45c1-1ce6-4f0f-8c72-a09e42ded1ff of volume 988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:18:46 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9ec21a-9655-43d4-b871-87fea9d09c93]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:18:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:46 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d Sep 16 16:18:46 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:47 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d" returned: 0 in 0.564s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:47 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff 1G Sep 16 16:18:47 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-613cb010-f0e8-405e-8e4d-8eac7fd95395 tempest-VolumesActionsTest-900816444 None] Acquiring lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418-detach_volume" by "detach_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-613cb010-f0e8-405e-8e4d-8eac7fd95395 tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-613cb010-f0e8-405e-8e4d-8eac7fd95395 tempest-VolumesActionsTest-900816444 None] Detaching volume cab7bda0-00ed-435e-a0d6-e9f3de89e418 from instance b923982c-9833-4a7b-8255-668b4fc17f38. Sep 16 16:18:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-613cb010-f0e8-405e-8e4d-8eac7fd95395 tempest-VolumesActionsTest-900816444 None] Detach volume completed successfully. Sep 16 16:18:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-613cb010-f0e8-405e-8e4d-8eac7fd95395 tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418-detach_volume" released by "detach_volume" :: held 0.175s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:18:48 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff 1G" returned: 0 in 0.950s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988d32bf-6259-474a-b044-f0555781427d -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:48 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988d32bf-6259-474a-b044-f0555781427d -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff Sep 16 16:18:48 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:48 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988d32bf-6259-474a-b044-f0555781427d -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff" returned: 0 in 0.633s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:48 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:18:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:48 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff Sep 16 16:18:48 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:48 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-e5541e39-eebc-4f5b-842f-ee9d5b956f5a req-7bd5c4cb-b627-4564-b2b5-5fa4e28bf36c tempest-TestStampPattern-840214300 None] Terminate volume connection completed successfully. Sep 16 16:18:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-e5541e39-eebc-4f5b-842f-ee9d5b956f5a req-7bd5c4cb-b627-4564-b2b5-5fa4e28bf36c tempest-TestStampPattern-840214300 None] Deleting attachment 29b25e7c-0af8-43d1-bdae-05a9d5e76ac4. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:18:49 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff" returned: 0 in 0.352s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:49 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.info Sep 16 16:18:49 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:49 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.info" returned: 0 in 0.301s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:49 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:49 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.info Sep 16 16:18:49 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:49 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.info" returned: 0 in 0.313s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.238s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.107s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Creating offline snapshot 5a500172-b8b3-4247-9c0e-47d1bf228280 of volume 53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0625880-3cd1-4d19-bdbb-ad054625c3c2]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:18:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:50 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-fd60e90c-5202-4d14-b108-bec39c469ba6 tempest-GroupSnapshotsTest-914175389 None] group_snapshot abeba3d2-e429-40a8-88c4-1c713284b34b: created successfully Sep 16 16:18:50 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 Sep 16 16:18:50 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:50 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" returned: 0 in 0.633s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:50 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 1G Sep 16 16:18:50 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:51 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 1G" returned: 0 in 0.587s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:51 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 Sep 16 16:18:51 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:51 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280" returned: 0 in 0.398s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:51 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 is being set with open permissions: ugo+rw Sep 16 16:18:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:51 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 Sep 16 16:18:51 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:52 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280" returned: 0 in 0.394s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:52 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.info Sep 16 16:18:52 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:52 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.info" returned: 0 in 0.328s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:52 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.info is being set with open permissions: ugo+rw Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:52 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.info Sep 16 16:18:52 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:52 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.info" returned: 0 in 0.277s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.782s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.817s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-509a45c1-1ce6-4f0f-8c72-a09e42ded1ff-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" by "_create_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-509a45c1-1ce6-4f0f-8c72-a09e42ded1ff-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Creating volume 7fa0c728-0a47-4cfb-b8a5-d7a333504b0e from snapshot 509a45c1-1ce6-4f0f-8c72-a09e42ded1ff {{(pid=86255) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:18:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-89bc6795-6ab5-46fd-aab1-ccf91d335562 tempest-TestStampPattern-840214300 None] Create snapshot completed successfully Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] snapshot: 509a45c1-1ce6-4f0f-8c72-a09e42ded1ff, volume: 7fa0c728-0a47-4cfb-b8a5-d7a333504b0e, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f5dd5f-7e3e-4720-a066-3604a2c2bc04]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:18:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:52 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff Sep 16 16:18:52 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:53 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff" returned: 0 in 0.601s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-988d32bf-6259-474a-b044-f0555781427d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:18:53 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4224be-064b-4373-a887-6f6aee4adb19]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:18:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:53 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d Sep 16 16:18:53 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:18:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:18:54 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 16 16:18:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d" returned: 0 in 0.536s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:18:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:18:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:18:54 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:18:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:18:54 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e Sep 16 16:18:54 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:02 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=32,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:19:02 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" returned: 0 in 8.908s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:02 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d, size 1024.00 MB, duration 8.91 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:19:02 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Converted 1024.00 MB image at 114.95 MB/s Sep 16 16:19:02 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:19:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:02 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e Sep 16 16:19:02 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:03 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" returned: 0 in 0.324s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" released by "_copy_volume_from_snapshot" :: held 10.490s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-509a45c1-1ce6-4f0f-8c72-a09e42ded1ff-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" released by "_create_volume_from_snapshot" :: held 10.585s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.615s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 9.450s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[696a4a80-94bb-4884-b783-30afb6b3b3fe]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:03 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c41bf8c1-c232-4303-bbbd-bba193624cfb tempest-GroupSnapshotsTest-914175389 None] Create group from source-snapshot-abeba3d2-e429-40a8-88c4-1c713284b34b completed successfully. Sep 16 16:19:03 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 Sep 16 16:19:03 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:03 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418" returned: 0 in 0.467s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd49fc-87d3-4e8f-99ef-dbac505c4c23]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:04 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 Sep 16 16:19:04 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:04 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418" returned: 0 in 0.491s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.ed39d593-0ffc-42dc-a717-1dfb51658468mo7ta___.img {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:04 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.ed39d593-0ffc-42dc-a717-1dfb51658468mo7ta___.img Sep 16 16:19:04 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:19:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:19:04 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b5f3a1-2bd3-40a8-b3db-435be57f0724]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:04 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e Sep 16 16:19:04 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:05 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" returned: 0 in 0.699s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:05 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e Sep 16 16:19:05 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:05 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:19:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Flow 'volume_create_manager' (dd0fe59c-bca2-4538-90b7-4e64e3a616bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:19:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4a4dd5-531b-4b21-aa3e-b85f3a59e2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4a4dd5-531b-4b21-aa3e-b85f3a59e2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1014117484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee9f697-743b-44f4-a816-de1e30d04f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373877a073b7454aa4ed46d9ed53871d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a500172-b8b3-4247-9c0e-47d1bf228280,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:06Z,use_quota=True,user_id='2c4d28f3ef5f4702b49105061937189a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0f13e4-ed59-4580-ab9b-54e66c931665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0f13e4-ed59-4580-ab9b-54e66c931665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66faea0d-65d0-4287-800f-fd9d2611fe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66faea0d-65d0-4287-800f-fd9d2611fe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fee9f697-743b-44f4-a816-de1e30d04f7e', 'volume_name': 'volume-fee9f697-743b-44f4-a816-de1e30d04f7e', 'volume_size': 1, 'snapshot_id': '5a500172-b8b3-4247-9c0e-47d1bf228280'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd83a8d4-9677-40d8-8489-47c09709fee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd83a8d4-9677-40d8-8489-47c09709fee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d49230-78e0-4427-ba33-f6dba5859ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Volume fee9f697-743b-44f4-a816-de1e30d04f7e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fee9f697-743b-44f4-a816-de1e30d04f7e', 'volume_size': 1, 'snapshot_id': '5a500172-b8b3-4247-9c0e-47d1bf228280'} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:06 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" returned: 0 in 0.834s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-7fa0c728-0a47-4cfb-b8a5-d7a333504b0e" released by "delete_volume" :: held 1.608s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Created reservations ['5a7eaff1-539d-4bb9-b4b3-3a73d7b95d3f'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:19:06 devstack cinder-volume[86255]: WARNING cinder.quota [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1301821424 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1301821424, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:19:06 devstack cinder-volume[86255]: WARNING cinder.quota [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1301821424 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1301821424, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Created reservations ['e1a9bc89-84ba-44e5-b7fb-03d43b2b4c2c', '8e7a2484-6b38-428f-8ef6-359a123de5e9', 'd7ba0481-abcb-4239-8a38-ed73bc20bc97', '913afcdd-c0e6-4b0d-bd38-fdf39885edbd'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:06 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:19:06 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:07 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.615s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:19:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4c4c7edb-bdf8-4806-94ee-08c2d37a6c97 tempest-GroupSnapshotsTest-914175389 None] Delete group completed successfully. Sep 16 16:19:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] group_snapshot abeba3d2-e429-40a8-88c4-1c713284b34b: deleting Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] group_snapshot abeba3d2-e429-40a8-88c4-1c713284b34b: deleting {{(pid=86255) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-988d32bf-6259-474a-b044-f0555781427d" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-988d32bf-6259-474a-b044-f0555781427d" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-509a45c1-1ce6-4f0f-8c72-a09e42ded1ff" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-509a45c1-1ce6-4f0f-8c72-a09e42ded1ff" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Deleting offline snapshot 509a45c1-1ce6-4f0f-8c72-a09e42ded1ff of volume 988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] snapshot_file for this snap is: volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9402bbec-4668-42f7-97b0-54bfc0f6113b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:08 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff Sep 16 16:19:08 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:08 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff" returned: 0 in 0.980s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-988d32bf-6259-474a-b044-f0555781427d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:19:09 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b98af85-9db6-44cd-ba0d-ba0f9205eb0e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:09 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d Sep 16 16:19:09 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:10 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d" returned: 0 in 1.003s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:10 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff Sep 16 16:19:10 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:11 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff" returned: 0 in 0.938s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:11 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff Sep 16 16:19:11 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:11 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d.509a45c1-1ce6-4f0f-8c72-a09e42ded1ff" returned: 0 in 0.571s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-509a45c1-1ce6-4f0f-8c72-a09e42ded1ff" released by "_delete_snapshot" :: held 3.817s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:19:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-988d32bf-6259-474a-b044-f0555781427d" released by "delete_snapshot" :: held 3.888s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:19:12 devstack cinder-volume[86255]: WARNING cinder.quota [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1301821424 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1301821424, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:19:12 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] Created reservations ['8a4a3ab9-3484-405e-aa75-a2c527ef3fdb', 'f53fb873-2602-4bd7-acad-a4caed330060', '4d00b8b7-c2cf-43e6-b22a-8c2dce19ff7e', '8c6e30d3-6ef8-487a-b8b5-d87fc3688d25'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:19:12 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c97cbf85-0f7f-488c-9c8c-d72eb572f848 tempest-GroupSnapshotsTest-914175389 None] group_snapshot abeba3d2-e429-40a8-88c4-1c713284b34b: deleted successfully Sep 16 16:19:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-988d32bf-6259-474a-b044-f0555781427d" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:19:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-988d32bf-6259-474a-b044-f0555781427d" acquired by "delete_volume" :: waited 0.062s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:19:13 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c0b20-6cef-44d1-a99d-95f9786e38a8]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:14 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d Sep 16 16:19:14 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:15 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:15 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.ed39d593-0ffc-42dc-a717-1dfb51658468mo7ta___.img" returned: 0 in 10.741s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d" returned: 0 in 1.379s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbc7318-d218-44f8-aaa4-a0b56be0a73a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:15 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d Sep 16 16:19:15 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:15 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 Sep 16 16:19:15 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:15 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-988d32bf-6259-474a-b044-f0555781427d" returned: 0 in 0.437s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-988d32bf-6259-474a-b044-f0555781427d" released by "delete_volume" :: held 1.996s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Created reservations ['59f9d14d-c860-4a2b-8944-4c96f332e10d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:19:15 devstack cinder-volume[86255]: WARNING cinder.db.api [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1301821424'] Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Created reservations ['0a39fbd0-4fd8-4336-bb54-9b6e7288d45e', 'a2d93b6c-7915-4238-acc1-ecc91a2adc6b', '9c60c095-41d8-45b1-a9c8-af036d8d404f', '10bc6814-5c76-49ad-973b-63abd26c7366'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:15 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418" returned: 0 in 0.876s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:16 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418, size 1024.00 MB, duration 10.74 sec, destination /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.ed39d593-0ffc-42dc-a717-1dfb51658468mo7ta___.img {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:19:16 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Converted 1024.00 MB image at 95.32 MB/s Sep 16 16:19:16 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:19:16 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:16 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] ed39d593-0ffc-42dc-a717-1dfb51658468 was raw, no need to convert to raw {{(pid=86255) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 16 16:19:16 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.317s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:16 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:19:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b40f5cf8-bf7e-4414-a690-8c68d899d24d tempest-GroupSnapshotsTest-914175389 None] Delete group completed successfully. Sep 16 16:19:17 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-46768c3a-e726-48af-8e13-2e52022ba7d0 tempest-GroupSnapshotsTest-914175389 None] Group tempest-GroupSnapshotsTest-Group-2142563497: creating Sep 16 16:19:17 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-46768c3a-e726-48af-8e13-2e52022ba7d0 tempest-GroupSnapshotsTest-914175389 None] Group tempest-GroupSnapshotsTest-Group-2142563497: created successfully Sep 16 16:19:17 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-46768c3a-e726-48af-8e13-2e52022ba7d0 tempest-GroupSnapshotsTest-914175389 None] Create group completed successfully. Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Flow 'volume_create_manager' (7f2e61de-0a78-441b-b094-b5a93eb1d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5616a1ce-e75a-4685-ad71-2f5b207cbca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5616a1ce-e75a-4685-ad71-2f5b207cbca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821949530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27a354bf-fb64-4481-945b-5c88dfdfce5e,host='devstack@QuobyteHD#QuobyteHD',id=65439174-4fa1-4b92-9d09-58a4fc6629d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161f0292b69a43069ed72006b4c99da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:19Z,use_quota=True,user_id='c3e3444499c34473a17f3e4bac2e4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef963335-3984-429e-90fd-67d578f20e5e),volume_type_id=ef963335-3984-429e-90fd-67d578f20e5e)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb0373f-2506-485e-be1e-af2bf7b1edb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb0373f-2506-485e-be1e-af2bf7b1edb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f696b77a-cc58-4937-9cd8-d9eb1bf560b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f696b77a-cc58-4937-9cd8-d9eb1bf560b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65439174-4fa1-4b92-9d09-58a4fc6629d1', 'volume_name': 'volume-65439174-4fa1-4b92-9d09-58a4fc6629d1', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1b7116-219d-47e0-8270-1bfb33156c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee1b7116-219d-47e0-8270-1bfb33156c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1395a7-2766-45f0-b0f6-4c7d09015550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:19 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Volume 65439174-4fa1-4b92-9d09-58a4fc6629d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65439174-4fa1-4b92-9d09-58a4fc6629d1', 'volume_size': 1} Sep 16 16:19:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:29 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=57,cinder:UPDATE=44,cinder:INSERT=9 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:19:29 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=34,cinder:UPDATE=33,cinder:INSERT=8 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Flow 'volume_create_manager' (529d43f6-21dc-45e8-be66-8910dbb5f41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255f8e27-4f6f-4bef-9612-1240974ae10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255f8e27-4f6f-4bef-9612-1240974ae10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-539632920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecba41317e8f4da988b9ec22d6280a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:35Z,use_quota=True,user_id='dabe990d45f24ba0b34387eaa617a960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2707c4-6943-40dc-81cd-224abcb3f785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2707c4-6943-40dc-81cd-224abcb3f785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f737908-29c6-4d7b-aaba-9fae141db8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f737908-29c6-4d7b-aaba-9fae141db8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa', 'volume_name': 'volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a077187-8279-4995-9673-3ef0f8e0a880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a077187-8279-4995-9673-3ef0f8e0a880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba189b41-693f-4f52-bfcf-3a58f2065b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Volume 0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Trying to clone 0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:19:35 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:19:35 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Image download 20.69 MB at 20.69 MB/s Sep 16 16:19:36 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b745801b-9fae-4455-ad6d-7fbd8589b0fa]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:36 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD Sep 16 16:19:36 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:36 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:36 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c is fetched for user dabe990d45f24ba0b34387eaa617a960. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:19:36 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef79a94b-a3ab-4d09-8d53-adfe23d12b6f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:36 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD Sep 16 16:19:36 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:36 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:41 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:19:41 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:41 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.286s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:19:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 40.959s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Uploaded volume to glance image-id: ed39d593-0ffc-42dc-a717-1dfb51658468. {{(pid=86255) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 38.182s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Acquiring lock "cinder-quobyte-5a500172-b8b3-4247-9c0e-47d1bf228280-fee9f697-743b-44f4-a816-de1e30d04f7e" by "_create_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-5a500172-b8b3-4247-9c0e-47d1bf228280-fee9f697-743b-44f4-a816-de1e30d04f7e" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Creating volume fee9f697-743b-44f4-a816-de1e30d04f7e from snapshot 5a500172-b8b3-4247-9c0e-47d1bf228280 {{(pid=86255) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Acquiring lock "cinder-quobyte-fee9f697-743b-44f4-a816-de1e30d04f7e" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:19:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-dda60c04-28e7-4c73-b53e-42e61aad66d1 tempest-VolumesActionsTest-900816444 None] Copy volume to image completed successfully. Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-fee9f697-743b-44f4-a816-de1e30d04f7e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] snapshot: 5a500172-b8b3-4247-9c0e-47d1bf228280, volume: fee9f697-743b-44f4-a816-de1e30d04f7e, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05438c2-abab-40dc-acbc-868ed31f75e6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:44 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 Sep 16 16:19:44 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:44 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280" returned: 0 in 0.389s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f808c6-bc1f-4607-b90f-1fb5a2553f68]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:44 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 Sep 16 16:19:44 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:45 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" returned: 0 in 0.391s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:19:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:19:45 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:19:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:45 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e Sep 16 16:19:45 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:52 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e" returned: 0 in 7.187s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3, size 1024.00 MB, duration 7.19 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:19:52 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Converted 1024.00 MB image at 142.46 MB/s Sep 16 16:19:52 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e is being set with open permissions: ugo+rw Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:52 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e Sep 16 16:19:52 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:52 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e" returned: 0 in 0.235s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-fee9f697-743b-44f4-a816-de1e30d04f7e" released by "_copy_volume_from_snapshot" :: held 8.290s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-5a500172-b8b3-4247-9c0e-47d1bf228280-fee9f697-743b-44f4-a816-de1e30d04f7e" released by "_create_volume_from_snapshot" :: held 8.355s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.376s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.952s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27a354bf-fb64-4481-945b-5c88dfdfce5e,created_at=2026-09-16T14:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-821949530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27a354bf-fb64-4481-945b-5c88dfdfce5e,host='devstack@QuobyteHD#QuobyteHD',id=65439174-4fa1-4b92-9d09-58a4fc6629d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161f0292b69a43069ed72006b4c99da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:19Z,use_quota=True,user_id='c3e3444499c34473a17f3e4bac2e4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef963335-3984-429e-90fd-67d578f20e5e),volume_type_id=ef963335-3984-429e-90fd-67d578f20e5e)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Creating volume 65439174-4fa1-4b92-9d09-58a4fc6629d1 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:19:52 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:52 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 1073741824 Sep 16 16:19:52 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d49230-78e0-4427-ba33-f6dba5859ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee9f697-743b-44f4-a816-de1e30d04f7e', 'volume_size': 1, 'snapshot_id': '5a500172-b8b3-4247-9c0e-47d1bf228280'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c659fb88-216e-4559-abf3-9dea96f677be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:52 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Volume volume-fee9f697-743b-44f4-a816-de1e30d04f7e (fee9f697-743b-44f4-a816-de1e30d04f7e): created successfully Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c659fb88-216e-4559-abf3-9dea96f677be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Flow 'volume_create_manager' (dd0fe59c-bca2-4538-90b7-4e64e3a616bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:19:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f3f74cd8-cfce-440b-8118-7b5f18f868cd tempest-TestStampPattern-840214300 None] Created volume successfully. Sep 16 16:19:53 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 1073741824" returned: 0 in 0.429s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:53 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 Sep 16 16:19:53 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:53 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1" returned: 0 in 0.262s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.521s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-539632920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecba41317e8f4da988b9ec22d6280a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:35Z,use_quota=True,user_id='dabe990d45f24ba0b34387eaa617a960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Creating volume 0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:19:53 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1395a7-2766-45f0-b0f6-4c7d09015550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65439174-4fa1-4b92-9d09-58a4fc6629d1', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012c7e8b-2b0e-4616-8d5d-d781b092c839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:53 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa 1073741824 Sep 16 16:19:53 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Volume volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 (65439174-4fa1-4b92-9d09-58a4fc6629d1): created successfully Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012c7e8b-2b0e-4616-8d5d-d781b092c839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Flow 'volume_create_manager' (7f2e61de-0a78-441b-b094-b5a93eb1d41a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:19:53 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0b5104de-ba30-4b3a-8652-ea1a4450ff56 tempest-GroupSnapshotsTest-914175389 None] Created volume successfully. Sep 16 16:19:53 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa 1073741824" returned: 0 in 0.517s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:54 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa Sep 16 16:19:54 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e269fa7d-e089-4da4-bd12-8181cfb73aac req-9e649d4b-e610-4298-b2a2-c52fdb8a9081 tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:54 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.647s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cfa9e8-4942-4082-93bc-56f41f17dd42]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Attempting download of cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume 0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d0c488-fb61-424f-9f94-4c15efd09361]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_xu0dsgqt {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:54 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 Sep 16 16:19:54 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:54 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_xu0dsgqt Sep 16 16:19:54 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Flow 'volume_create_manager' (501ca0ff-c100-4637-8084-913de184b8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3d5de9-1dc0-4467-a57c-4ab6bc6b95af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3d5de9-1dc0-4467-a57c-4ab6bc6b95af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858461980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27a354bf-fb64-4481-945b-5c88dfdfce5e,host='devstack@QuobyteHD#QuobyteHD',id=87da19c1-675a-42f4-bde8-56606a90a9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161f0292b69a43069ed72006b4c99da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:55Z,use_quota=True,user_id='c3e3444499c34473a17f3e4bac2e4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef963335-3984-429e-90fd-67d578f20e5e),volume_type_id=ef963335-3984-429e-90fd-67d578f20e5e)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc221845-7631-4f49-a8a3-919dbaac5b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc221845-7631-4f49-a8a3-919dbaac5b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6fc113-ecbc-4451-acb1-5b54be8bb4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6fc113-ecbc-4451-acb1-5b54be8bb4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87da19c1-675a-42f4-bde8-56606a90a9da', 'volume_name': 'volume-87da19c1-675a-42f4-bde8-56606a90a9da', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fc2c9e-4775-4a31-8a8d-a04361207921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80fc2c9e-4775-4a31-8a8d-a04361207921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbf01a2-a5cc-4728-b425-c3fdf8c56b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:19:54 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Volume 87da19c1-675a-42f4-bde8-56606a90a9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87da19c1-675a-42f4-bde8-56606a90a9da', 'volume_size': 1} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:19:54 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418" returned: 0 in 0.455s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd84cd1-c6cb-4398-b94f-20f1895e6727]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:54 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_xu0dsgqt" returned: 0 in 0.410s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_xu0dsgqt {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:54 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 Sep 16 16:19:54 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:54 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_xu0dsgqt Sep 16 16:19:54 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:55 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418" returned: 0 in 0.380s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:55 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_xu0dsgqt" returned: 1 in 0.349s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_xu0dsgqt' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:19:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[403c3e0a-d8dc-4424-b079-ea8457bdde59]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:19:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:55 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img Sep 16 16:19:55 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:55 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD Sep 16 16:19:55 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:19:55 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 16 16:19:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:19:55 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] cceeac4d-0fa7-4694-a045-5c6e3d003f4c was qcow2, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:19:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:19:55 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa Sep 16 16:19:55 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:00 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa" returned: 0 in 5.053s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:00 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_g9ecb27bdevstack@QuobyteHD, size 112.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:20:00 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Converted 112.00 MB image at 22.16 MB/s Sep 16 16:20:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:00 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa 1G Sep 16 16:20:00 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:01 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa 1G" returned: 0 in 0.564s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Downloaded image cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume 0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c for user dabe990d45f24ba0b34387eaa617a960 is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Marking volume 0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Copying metadata from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c to 0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Creating volume glance metadata for volume 0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa backed by image cceeac4d-0fa7-4694-a045-5c6e3d003f4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba189b41-693f-4f52-bfcf-3a58f2065b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315a88a1-b586-4cb0-9fb0-9ca482374bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:01 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Volume volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa (0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa): created successfully Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315a88a1-b586-4cb0-9fb0-9ca482374bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Flow 'volume_create_manager' (529d43f6-21dc-45e8-be66-8910dbb5f41b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:20:01 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-410a01f9-41bd-4579-a680-a4635a368cd1 tempest-TestShelveInstance-392634653 None] Created volume successfully. Sep 16 16:20:02 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img" returned: 0 in 6.946s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:02 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1580df19-cd81-485e-b9b1-5f0206c59648]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:02 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 Sep 16 16:20:02 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:02 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418" returned: 0 in 0.540s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:02 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:20:02 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Converted 1024.00 MB image at 147.40 MB/s Sep 16 16:20:02 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] dde81d66-de71-4587-af47-1cb4b6f1b1db was raw, converting to qcow2 {{(pid=86255) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 16 16:20:02 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[025d0ff6-48bb-44c4-892c-fcc56d9ee5f7]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:02 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img Sep 16 16:20:02 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:02 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img" returned: 0 in 0.335s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:03 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img Sep 16 16:20:03 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:03 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img" returned: 1 in 0.363s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img /opt/stack/data/cinder/conversion/vol_upload_g4mplb4s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:03 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img /opt/stack/data/cinder/conversion/vol_upload_g4mplb4s Sep 16 16:20:03 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:03 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img /opt/stack/data/cinder/conversion/vol_upload_g4mplb4s" returned: 0 in 0.285s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Image conversion details: src /opt/stack/data/cinder/conversion/cab7bda0-00ed-435e-a0d6-e9f3de89e418.temp_image.dde81d66-de71-4587-af47-1cb4b6f1b1db3m33lnf3.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_g4mplb4s {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:20:03 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd38001-f465-4cd5-a177-8094810a2235]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g4mplb4s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:03 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g4mplb4s Sep 16 16:20:03 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:03 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_g4mplb4s" returned: 0 in 0.343s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-7ec39051-9b24-4818-9eac-70f753b09778 req-97997135-73e9-4e97-97dc-594ed02709e9 tempest-TestShelveInstance-392634653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.406s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Uploaded volume to glance image-id: dde81d66-de71-4587-af47-1cb4b6f1b1db. {{(pid=86255) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e269fa7d-e089-4da4-bd12-8181cfb73aac req-9e649d4b-e610-4298-b2a2-c52fdb8a9081 tempest-TestStampPattern-840214300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.519s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e269fa7d-e089-4da4-bd12-8181cfb73aac req-9e649d4b-e610-4298-b2a2-c52fdb8a9081 tempest-TestStampPattern-840214300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.975s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=27a354bf-fb64-4481-945b-5c88dfdfce5e,created_at=2026-09-16T14:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858461980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=27a354bf-fb64-4481-945b-5c88dfdfce5e,host='devstack@QuobyteHD#QuobyteHD',id=87da19c1-675a-42f4-bde8-56606a90a9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161f0292b69a43069ed72006b4c99da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:19:55Z,use_quota=True,user_id='c3e3444499c34473a17f3e4bac2e4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef963335-3984-429e-90fd-67d578f20e5e),volume_type_id=ef963335-3984-429e-90fd-67d578f20e5e)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Creating volume 87da19c1-675a-42f4-bde8-56606a90a9da {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:20:05 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f8f3752d-9785-4e0d-ac47-4e25db14300b tempest-VolumesActionsTest-900816444 None] Copy volume to image completed successfully. Sep 16 16:20:05 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da 1073741824 Sep 16 16:20:05 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-e269fa7d-e089-4da4-bd12-8181cfb73aac req-9e649d4b-e610-4298-b2a2-c52fdb8a9081 tempest-TestStampPattern-840214300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-fee9f697-743b-44f4-a816-de1e30d04f7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab389b81-a2fe-46e3-860a-a3671efff3c9', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:20:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-e269fa7d-e089-4da4-bd12-8181cfb73aac req-9e649d4b-e610-4298-b2a2-c52fdb8a9081 tempest-TestStampPattern-840214300 None] attachment_update completed successfully. Sep 16 16:20:06 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da 1073741824" returned: 0 in 0.604s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:06 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da Sep 16 16:20:06 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:06 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da" returned: 0 in 0.320s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-7ec39051-9b24-4818-9eac-70f753b09778 req-97997135-73e9-4e97-97dc-594ed02709e9 tempest-TestShelveInstance-392634653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.783s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-7ec39051-9b24-4818-9eac-70f753b09778 req-97997135-73e9-4e97-97dc-594ed02709e9 tempest-TestShelveInstance-392634653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbf01a2-a5cc-4728-b425-c3fdf8c56b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87da19c1-675a-42f4-bde8-56606a90a9da', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cad328e-42cd-459a-9c68-a00d9aeae019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Volume volume-87da19c1-675a-42f4-bde8-56606a90a9da (87da19c1-675a-42f4-bde8-56606a90a9da): created successfully Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cad328e-42cd-459a-9c68-a00d9aeae019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Flow 'volume_create_manager' (501ca0ff-c100-4637-8084-913de184b8ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:20:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-7ec39051-9b24-4818-9eac-70f753b09778 req-97997135-73e9-4e97-97dc-594ed02709e9 tempest-TestShelveInstance-392634653 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d645983-88a4-4003-957f-e5cd0a96f959', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:20:06 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5c85ac7d-317f-4224-8a4f-dc2bf62b4f36 tempest-GroupSnapshotsTest-914175389 None] Created volume successfully. Sep 16 16:20:06 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-7ec39051-9b24-4818-9eac-70f753b09778 req-97997135-73e9-4e97-97dc-594ed02709e9 tempest-TestShelveInstance-392634653 None] attachment_update completed successfully. Sep 16 16:20:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Acquiring lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Acquiring lock "cinder-quobyte-cab7bda0-00ed-435e-a0d6-e9f3de89e418" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Lock "cinder-quobyte-cab7bda0-00ed-435e-a0d6-e9f3de89e418" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:07 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccf5ca4-c8de-4817-adf2-236bf8dbadd6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3a6f220a-3baa-4474-8dda-9a0ec240c2e0 tempest-GroupSnapshotsTest-914175389 None] Update group completed successfully. Sep 16 16:20:07 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 Sep 16 16:20:07 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:08 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418" returned: 0 in 0.646s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:08 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418 Sep 16 16:20:08 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:08 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cab7bda0-00ed-435e-a0d6-e9f3de89e418" returned: 0 in 0.647s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Lock "cinder-quobyte-cab7bda0-00ed-435e-a0d6-e9f3de89e418" released by "delete_volume" :: held 1.373s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-afbbfb68-5d62-4a08-9872-4115a934015d tempest-GroupSnapshotsTest-914175389 None] Update group completed successfully. Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Created reservations ['05084c12-7a36-4d04-907f-1df1348ddd1f', '2a457830-c7e2-4c9d-9ab4-467fcad2140b', '20d6aca3-c8a4-40a4-a238-f45d6d056e53', 'a974c1d8-815b-4959-a69f-6500cc544a38'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:09 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:20:09 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:09 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.352s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:20:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Deleted volume successfully. Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a95bf07f-76ed-41d8-984d-602a9a069839 tempest-VolumesActionsTest-900816444 None] Lock "cinder-cab7bda0-00ed-435e-a0d6-e9f3de89e418-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-cfd75d30-f4ab-4bfd-9cc6-6a855c95376c req-4efb24d5-8a48-4b3b-bc15-449b00e650d3 tempest-TestStampPattern-840214300 None] Terminate volume connection completed successfully. Sep 16 16:20:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-cfd75d30-f4ab-4bfd-9cc6-6a855c95376c req-4efb24d5-8a48-4b3b-bc15-449b00e650d3 tempest-TestStampPattern-840214300 None] Deleting attachment ab389b81-a2fe-46e3-860a-a3671efff3c9. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:20:10 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b8e06c09-6c48-4255-a524-64fd44c1bd7d tempest-GroupSnapshotsTest-914175389 None] Update group completed successfully. Sep 16 16:20:11 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-777bbfec-7776-4c4d-a0bb-57303aa054a5 tempest-GroupSnapshotsTest-914175389 None] Update group completed successfully. Sep 16 16:20:13 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] GroupSnapshot d993bced-fdcc-460c-b2c4-b9159e958ff2: creating. Sep 16 16:20:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Group snapshot d993bced-fdcc-460c-b2c4-b9159e958ff2: creating. {{(pid=86255) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 16 16:20:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Creating offline snapshot 40ca0889-20df-453a-8f50-dc3b22031aea of volume 65439174-4fa1-4b92-9d09-58a4fc6629d1 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:20:13 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[333980fa-d471-4f13-803e-c4227c6d54d2]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:14 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 Sep 16 16:20:14 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:14 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1" returned: 0 in 0.671s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:14 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea 1G Sep 16 16:20:14 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:15 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea 1G" returned: 0 in 0.656s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:15 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea Sep 16 16:20:15 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:15 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea" returned: 0 in 0.707s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:15 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:20:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:16 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea Sep 16 16:20:16 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Acquiring lock "cinder-fee9f697-743b-44f4-a816-de1e30d04f7e-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Lock "cinder-fee9f697-743b-44f4-a816-de1e30d04f7e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Acquiring lock "cinder-quobyte-fee9f697-743b-44f4-a816-de1e30d04f7e" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-fee9f697-743b-44f4-a816-de1e30d04f7e" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:16 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[973151d2-72ad-43ad-bcf9-0cb7ad7fd449]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:16 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea" returned: 0 in 0.715s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:16 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.info Sep 16 16:20:16 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:16 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e Sep 16 16:20:16 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:17 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.info" returned: 0 in 0.567s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:17 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:20:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:17 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.info Sep 16 16:20:17 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:17 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e" returned: 0 in 0.776s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:17 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e Sep 16 16:20:17 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:17 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.info" returned: 0 in 0.631s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.134s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:18 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fee9f697-743b-44f4-a816-de1e30d04f7e" returned: 0 in 0.559s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Creating offline snapshot 448d6704-c678-45df-bb91-66c3cc808d0a of volume 87da19c1-675a-42f4-bde8-56606a90a9da {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-fee9f697-743b-44f4-a816-de1e30d04f7e" released by "delete_volume" :: held 1.444s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d7d541-4a0e-4d99-b6e8-1cc12b8a18d1]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Created reservations ['fb980a61-fada-47b4-ab08-3e713a5e80cc', 'cef221f7-6457-4719-ad3b-85f76898e904', 'ef7328fe-e349-48b4-b2d7-bd9ae1dedc14', '99aa935e-a4e5-4595-8df4-0a3fa5ffb722'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:18 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:20:18 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:18 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da Sep 16 16:20:18 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:18 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.385s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:20:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Deleted volume successfully. Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-98e5a52d-a337-4e1c-90fc-b92ea5c93eea tempest-TestStampPattern-840214300 None] Lock "cinder-fee9f697-743b-44f4-a816-de1e30d04f7e-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:18 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da" returned: 0 in 0.748s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:18 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a 1G Sep 16 16:20:18 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Acquiring lock "cinder-5a500172-b8b3-4247-9c0e-47d1bf228280-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Lock "cinder-5a500172-b8b3-4247-9c0e-47d1bf228280-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Acquiring lock "cinder-quobyte-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Acquiring lock "cinder-quobyte-5a500172-b8b3-4247-9c0e-47d1bf228280" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-5a500172-b8b3-4247-9c0e-47d1bf228280" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Deleting offline snapshot 5a500172-b8b3-4247-9c0e-47d1bf228280 of volume 53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] snapshot_file for this snap is: volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc539551-a5d4-4d4b-a9bd-1577ce5afb0c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:19 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 Sep 16 16:20:19 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:19 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a 1G" returned: 0 in 0.994s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87da19c1-675a-42f4-bde8-56606a90a9da -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:19 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87da19c1-675a-42f4-bde8-56606a90a9da -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a Sep 16 16:20:19 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:20 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280" returned: 0 in 0.613s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:20:20 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[197c98bb-e920-41bf-abbc-041c3c1bc20a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:20 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87da19c1-675a-42f4-bde8-56606a90a9da -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a" returned: 0 in 0.516s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:20 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:20:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:20 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 Sep 16 16:20:20 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:20 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a Sep 16 16:20:20 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:20 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a" returned: 0 in 0.427s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:20 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.info Sep 16 16:20:20 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:21 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" returned: 0 in 0.959s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:21 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 Sep 16 16:20:21 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:21 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.info" returned: 0 in 0.403s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:21 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:20:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:21 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.info Sep 16 16:20:21 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:21 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.info" returned: 0 in 0.342s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.647s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:21 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280" returned: 0 in 0.580s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:21 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280 Sep 16 16:20:21 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:21 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c0acd150-4501-4722-8b36-012727d9842e tempest-GroupSnapshotsTest-914175389 None] group_snapshot d993bced-fdcc-460c-b2c4-b9159e958ff2: created successfully Sep 16 16:20:22 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3.5a500172-b8b3-4247-9c0e-47d1bf228280" returned: 0 in 0.282s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-5a500172-b8b3-4247-9c0e-47d1bf228280" released by "_delete_snapshot" :: held 2.606s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" released by "delete_snapshot" :: held 2.651s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Created reservations ['75f4c33c-e868-4ec9-a4c5-ca175e9688ce', '93009d28-c0a4-488f-9396-44a6b57096c1', 'c933657b-2c0b-4d14-af8d-f67cfb6f03f4', 'e3a67a58-e67e-4eb8-a7f0-3197eeb16b99'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Delete snapshot completed successfully. Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0aac447b-46f6-4f85-9abd-bdc5942718ca tempest-TestStampPattern-840214300 None] Lock "cinder-5a500172-b8b3-4247-9c0e-47d1bf228280-delete_snapshot" released by "delete_snapshot" :: held 2.845s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] group_snapshot d993bced-fdcc-460c-b2c4-b9159e958ff2: deleting Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] group_snapshot d993bced-fdcc-460c-b2c4-b9159e958ff2: deleting {{(pid=86255) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-65439174-4fa1-4b92-9d09-58a4fc6629d1" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-65439174-4fa1-4b92-9d09-58a4fc6629d1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-40ca0889-20df-453a-8f50-dc3b22031aea" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-40ca0889-20df-453a-8f50-dc3b22031aea" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Deleting offline snapshot 40ca0889-20df-453a-8f50-dc3b22031aea of volume 65439174-4fa1-4b92-9d09-58a4fc6629d1 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] snapshot_file for this snap is: volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f688224-a66e-46eb-abff-0d4a746237ce]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:23 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea Sep 16 16:20:23 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:23 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea" returned: 0 in 0.538s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65439174-4fa1-4b92-9d09-58a4fc6629d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff53729e-d54c-47ac-8b7b-0aa1620c4cbd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Flow 'volume_create_manager' (09498300-d070-49b3-881c-804f0e76117b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4230adee-1450-4f1e-af8b-95fcdea1d6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:23 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 Sep 16 16:20:23 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4230adee-1450-4f1e-af8b-95fcdea1d6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1845052539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc855b5d-47f2-4fe3-a100-8519794ec20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74db3523a44161aadf3218a0d655bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:23Z,use_quota=True,user_id='39c28104771c41eb85d8ea55b7bddbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dca3b63-88cd-49ad-9d46-d3d95fba283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dca3b63-88cd-49ad-9d46-d3d95fba283c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb3b844-cf42-4bec-bcc6-9b77c4bf107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:20:23 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1" returned: 0 in 0.453s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb3b844-cf42-4bec-bcc6-9b77c4bf107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fc855b5d-47f2-4fe3-a100-8519794ec20a', 'volume_name': 'volume-fc855b5d-47f2-4fe3-a100-8519794ec20a', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:23 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea Sep 16 16:20:23 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43325bb9-04bc-4c81-8f70-a6993c8a3dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43325bb9-04bc-4c81-8f70-a6993c8a3dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f8c7a4-e89c-4d45-8b3c-ae6cde804c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:23 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Volume fc855b5d-47f2-4fe3-a100-8519794ec20a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fc855b5d-47f2-4fe3-a100-8519794ec20a', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 16:20:23 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Trying to clone fc855b5d-47f2-4fe3-a100-8519794ec20a from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:20:24 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:20:24 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Image download 20.69 MB at 20.69 MB/s Sep 16 16:20:24 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aaa9f4-f06d-446a-915e-d361b1a2ab4c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:24 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea" returned: 0 in 0.657s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:24 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea Sep 16 16:20:24 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:24 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD Sep 16 16:20:24 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:25 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:25 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c is fetched for user 39c28104771c41eb85d8ea55b7bddbb9. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1.40ca0889-20df-453a-8f50-dc3b22031aea" returned: 0 in 0.490s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-40ca0889-20df-453a-8f50-dc3b22031aea" released by "_delete_snapshot" :: held 2.320s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-65439174-4fa1-4b92-9d09-58a4fc6629d1" released by "delete_snapshot" :: held 2.399s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-87da19c1-675a-42f4-bde8-56606a90a9da" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-87da19c1-675a-42f4-bde8-56606a90a9da" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-448d6704-c678-45df-bb91-66c3cc808d0a" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-448d6704-c678-45df-bb91-66c3cc808d0a" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Deleting offline snapshot 448d6704-c678-45df-bb91-66c3cc808d0a of volume 87da19c1-675a-42f4-bde8-56606a90a9da {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] snapshot_file for this snap is: volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e9072-4e8b-4949-802e-96ed491058f4]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0c6a1b-ef61-4de1-8950-495f2e5c81dd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:25 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a Sep 16 16:20:25 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:25 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD Sep 16 16:20:25 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:25 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a" returned: 0 in 0.495s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87da19c1-675a-42f4-bde8-56606a90a9da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:20:25 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD" returned: 0 in 0.509s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1845052539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc855b5d-47f2-4fe3-a100-8519794ec20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74db3523a44161aadf3218a0d655bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:23Z,use_quota=True,user_id='39c28104771c41eb85d8ea55b7bddbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Creating volume fc855b5d-47f2-4fe3-a100-8519794ec20a {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:20:26 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda3cd26-4335-4a3b-880a-514871b241fc]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:26 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a 1073741824 Sep 16 16:20:26 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:26 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da Sep 16 16:20:26 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:26 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da" returned: 0 in 0.680s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:26 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a Sep 16 16:20:26 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:26 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a 1073741824" returned: 0 in 0.855s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:27 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a Sep 16 16:20:27 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:27 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a" returned: 0 in 0.501s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:27 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a Sep 16 16:20:27 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:27 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a" returned: 0 in 0.428s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Attempting download of cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume fc855b5d-47f2-4fe3-a100-8519794ec20a. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd699d4-8378-4da2-b684-cd4790900e59]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_56ybhmw1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:27 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_56ybhmw1 Sep 16 16:20:27 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:27 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da.448d6704-c678-45df-bb91-66c3cc808d0a" returned: 0 in 0.483s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-448d6704-c678-45df-bb91-66c3cc808d0a" released by "_delete_snapshot" :: held 2.388s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-87da19c1-675a-42f4-bde8-56606a90a9da" released by "delete_snapshot" :: held 2.448s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:27 devstack cinder-volume[86255]: WARNING cinder.quota [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-435095435 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-435095435, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:20:27 devstack cinder-volume[86255]: WARNING cinder.quota [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-435095435 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-435095435, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:20:27 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_56ybhmw1" returned: 0 in 0.403s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_56ybhmw1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Acquiring lock "cinder-53340cf5-e8b9-4b26-9454-1c1e4f0596b3-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Created reservations ['4e8c9fb5-3821-4a9f-a3f9-2077fc546399', 'f4516265-97c4-4c83-8fc6-a015154744e6', '60f3c063-9cb2-42e2-8e5e-cd1ce4fab37b', 'fdea108e-70a2-405a-9b29-5c2f42694ecb'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Lock "cinder-53340cf5-e8b9-4b26-9454-1c1e4f0596b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Acquiring lock "cinder-quobyte-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:28 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_56ybhmw1 Sep 16 16:20:28 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b01a43-30ef-4595-b96c-508105e31965]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] Created reservations ['6a8dcd32-a1c7-4f31-a4e5-846a489f3e03', 'c6730c20-809a-4704-8345-8b5a3e93926c', '86c98660-236b-44b7-8def-988fcadcc185', '760e1be1-c670-4527-b3dc-8811089280b5'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:28 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 Sep 16 16:20:28 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3f632924-3b97-47ce-a7b1-04f359ef7522 tempest-GroupSnapshotsTest-914175389 None] group_snapshot d993bced-fdcc-460c-b2c4-b9159e958ff2: deleted successfully Sep 16 16:20:28 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_56ybhmw1" returned: 1 in 0.468s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_56ybhmw1' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d0fb42-a1ea-4d3c-a620-22605014199b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:28 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD Sep 16 16:20:28 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:28 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" returned: 0 in 0.549s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:28 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3 Sep 16 16:20:28 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:28 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] cceeac4d-0fa7-4694-a045-5c6e3d003f4c was qcow2, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:20:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:28 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a Sep 16 16:20:28 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:29 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" returned: 0 in 0.307s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Lock "cinder-quobyte-53340cf5-e8b9-4b26-9454-1c1e4f0596b3" released by "delete_volume" :: held 0.972s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Created reservations ['f63e268e-963f-45e2-8b0f-cc38061b743b', '26cf6707-b3ad-4fc7-bd64-deca6ae61887', '79ba9f88-5fa6-4320-89de-3dda44ef7824', 'ed39d58f-9dcb-44d6-addc-c491a4575a68'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-65439174-4fa1-4b92-9d09-58a4fc6629d1" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-65439174-4fa1-4b92-9d09-58a4fc6629d1" acquired by "delete_volume" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:29 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:20:29 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[db62b56a-1c6a-498f-b122-2cca83d96937]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:29 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 Sep 16 16:20:29 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:29 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.338s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:20:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Deleted volume successfully. Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=86,cinder:INSERT=26,cinder:UPDATE=62,cinder:DELETE=4 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-beb04ab9-602d-4fb3-9aaf-47e18ded8dea tempest-TestStampPattern-840214300 None] Lock "cinder-53340cf5-e8b9-4b26-9454-1c1e4f0596b3-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:29 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1" returned: 0 in 0.480s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:29 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1 Sep 16 16:20:29 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:30 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-65439174-4fa1-4b92-9d09-58a4fc6629d1" returned: 0 in 0.269s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-65439174-4fa1-4b92-9d09-58a4fc6629d1" released by "delete_volume" :: held 0.835s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-87da19c1-675a-42f4-bde8-56606a90a9da" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-87da19c1-675a-42f4-bde8-56606a90a9da" acquired by "delete_volume" :: waited 0.013s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:30 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f7ca68-fd8e-4523-a557-63bfb551cc3e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:30 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da Sep 16 16:20:30 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:30 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:30 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da Sep 16 16:20:30 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:31 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-87da19c1-675a-42f4-bde8-56606a90a9da" returned: 0 in 0.318s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-87da19c1-675a-42f4-bde8-56606a90a9da" released by "delete_volume" :: held 0.853s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=82,cinder:UPDATE=77,cinder:DELETE=3,cinder:INSERT=19 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Created reservations ['bd5b5c6b-ad8d-4d0f-bf70-80f515039321'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:31 devstack cinder-volume[86255]: WARNING cinder.quota [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-435095435 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-435095435, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:20:31 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Created reservations ['a0baa830-b8b9-4024-b5c4-762c5e245887', '9b8cd784-4106-48d0-9862-c2af351ad9ce', 'f87f8473-c7cb-4c1b-b238-617c214b4089', 'f5d6d7f9-e2d1-43c3-b6f2-2982592b246a'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a" returned: 0 in 2.327s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_imkqx2dbdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:20:31 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Converted 112.00 MB image at 48.10 MB/s Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:31 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a 1G Sep 16 16:20:31 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Created reservations ['bb660bc1-4589-49a9-9051-f594d564f8d7', 'ea7e21c6-42cf-414d-802f-e3707611c743', 'ed831196-c05f-41f4-8615-123394ecbbf1', 'ed360b9d-ab40-444f-b501-4abae27d7784'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:31 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:20:31 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:31 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a 1G" returned: 0 in 0.423s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Downloaded image cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume fc855b5d-47f2-4fe3-a100-8519794ec20a successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c for user 39c28104771c41eb85d8ea55b7bddbb9 is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Marking volume fc855b5d-47f2-4fe3-a100-8519794ec20a as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Copying metadata from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c to fc855b5d-47f2-4fe3-a100-8519794ec20a. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Creating volume glance metadata for volume fc855b5d-47f2-4fe3-a100-8519794ec20a backed by image cceeac4d-0fa7-4694-a045-5c6e3d003f4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f8c7a4-e89c-4d45-8b3c-ae6cde804c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc855b5d-47f2-4fe3-a100-8519794ec20a', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac7cba0-1a45-4095-8680-aa72f6554d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:31 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Volume volume-fc855b5d-47f2-4fe3-a100-8519794ec20a (fc855b5d-47f2-4fe3-a100-8519794ec20a): created successfully Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac7cba0-1a45-4095-8680-aa72f6554d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Flow 'volume_create_manager' (09498300-d070-49b3-881c-804f0e76117b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:20:31 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.346s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b02cf9b2-e770-45bf-a02c-9bcb1f0ff2fb tempest-VolumesExtendTest-1367647781 None] Created volume successfully. Sep 16 16:20:31 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:20:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f34707f5-763b-45af-badb-0efccda12cdf tempest-GroupSnapshotsTest-914175389 None] Delete group completed successfully. Sep 16 16:20:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c78b0e90-e711-4d8d-b1be-ef39b9098df0 tempest-VolumesExtendTest-1367647781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c78b0e90-e711-4d8d-b1be-ef39b9098df0 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:32 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eae943-eb2d-4c9b-81a9-69bbccbbd100]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c78b0e90-e711-4d8d-b1be-ef39b9098df0 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-40ef9a92-b3c9-4144-b2b6-86ec9b4b7e41 tempest-GroupSnapshotsTest-914175389 None] Group tempest-GroupSnapshotsTest-Group-680336436: creating Sep 16 16:20:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-40ef9a92-b3c9-4144-b2b6-86ec9b4b7e41 tempest-GroupSnapshotsTest-914175389 None] Group tempest-GroupSnapshotsTest-Group-680336436: created successfully Sep 16 16:20:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-40ef9a92-b3c9-4144-b2b6-86ec9b4b7e41 tempest-GroupSnapshotsTest-914175389 None] Create group completed successfully. Sep 16 16:20:32 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a Sep 16 16:20:32 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:32 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c78b0e90-e711-4d8d-b1be-ef39b9098df0 tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a" returned: 0 in 0.432s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c78b0e90-e711-4d8d-b1be-ef39b9098df0 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a 2G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c78b0e90-e711-4d8d-b1be-ef39b9098df0 tempest-VolumesExtendTest-1367647781 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a 2G" returned: 0 in 0.104s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c78b0e90-e711-4d8d-b1be-ef39b9098df0 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.579s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c78b0e90-e711-4d8d-b1be-ef39b9098df0 tempest-VolumesExtendTest-1367647781 None] Extend volume completed successfully. Sep 16 16:20:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Acquiring lock "cinder-fc855b5d-47f2-4fe3-a100-8519794ec20a-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Lock "cinder-fc855b5d-47f2-4fe3-a100-8519794ec20a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Acquiring lock "cinder-quobyte-fc855b5d-47f2-4fe3-a100-8519794ec20a" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Lock "cinder-quobyte-fc855b5d-47f2-4fe3-a100-8519794ec20a" acquired by "delete_volume" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:33 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dc61b3-5f99-4f45-a1c2-0e71dc52f156]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:34 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a Sep 16 16:20:34 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Flow 'volume_create_manager' (07fe7a01-d53b-4ae1-b594-a96eb491b658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53667788-895a-4db5-ac80-fd7e71c11c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53667788-895a-4db5-ac80-fd7e71c11c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2089542600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37dbb393-43eb-4986-a9a2-cd3659cee7c2,host='devstack@QuobyteHD#QuobyteHD',id=53b25762-f445-494c-b014-3d4854e9adf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161f0292b69a43069ed72006b4c99da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:34Z,use_quota=True,user_id='c3e3444499c34473a17f3e4bac2e4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80cbf0fd-98e0-4c11-a4b8-4b563708aae4),volume_type_id=80cbf0fd-98e0-4c11-a4b8-4b563708aae4)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fe2f8b-320e-4101-ae27-85aca919834f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fe2f8b-320e-4101-ae27-85aca919834f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09829d2-6071-4f63-8e55-d529d02bf6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09829d2-6071-4f63-8e55-d529d02bf6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b25762-f445-494c-b014-3d4854e9adf7', 'volume_name': 'volume-53b25762-f445-494c-b014-3d4854e9adf7', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1a20d3-4450-4f6b-b567-850d8132504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea1a20d3-4450-4f6b-b567-850d8132504b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7734ef0-2853-4163-8847-ab19d66f060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Volume 53b25762-f445-494c-b014-3d4854e9adf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b25762-f445-494c-b014-3d4854e9adf7', 'volume_size': 1} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=37dbb393-43eb-4986-a9a2-cd3659cee7c2,created_at=2026-09-16T14:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2089542600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37dbb393-43eb-4986-a9a2-cd3659cee7c2,host='devstack@QuobyteHD#QuobyteHD',id=53b25762-f445-494c-b014-3d4854e9adf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161f0292b69a43069ed72006b4c99da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:34Z,use_quota=True,user_id='c3e3444499c34473a17f3e4bac2e4af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(80cbf0fd-98e0-4c11-a4b8-4b563708aae4),volume_type_id=80cbf0fd-98e0-4c11-a4b8-4b563708aae4)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Creating volume 53b25762-f445-494c-b014-3d4854e9adf7 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:20:34 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:34 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 1073741824 Sep 16 16:20:34 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:34 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a" returned: 0 in 0.462s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:34 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a Sep 16 16:20:34 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:34 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fc855b5d-47f2-4fe3-a100-8519794ec20a" returned: 0 in 0.440s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Lock "cinder-quobyte-fc855b5d-47f2-4fe3-a100-8519794ec20a" released by "delete_volume" :: held 0.960s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:34 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Created reservations ['39cf87c3-feee-46b9-b555-74e343dda728', 'fb823f41-f6be-43a3-a8bc-834c2e4d5809', 'bef04357-aa2b-4969-a24e-9be7d438f05d', '77fcb378-286d-4a9a-a320-7fda37785bc9'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:35 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 1073741824" returned: 0 in 0.746s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:35 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:20:35 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:35 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 Sep 16 16:20:35 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:35 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:20:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Deleted volume successfully. Sep 16 16:20:35 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7" returned: 0 in 0.299s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c15e4fa-1df4-4142-94e5-0aae2777048b tempest-VolumesExtendTest-1367647781 None] Lock "cinder-fc855b5d-47f2-4fe3-a100-8519794ec20a-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7734ef0-2853-4163-8847-ab19d66f060f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b25762-f445-494c-b014-3d4854e9adf7', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b306856-a27e-4901-8a47-00a3c41611d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Volume volume-53b25762-f445-494c-b014-3d4854e9adf7 (53b25762-f445-494c-b014-3d4854e9adf7): created successfully Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b306856-a27e-4901-8a47-00a3c41611d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Flow 'volume_create_manager' (07fe7a01-d53b-4ae1-b594-a96eb491b658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:20:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-94b4a80b-f5ec-4796-be78-282dc634b6a9 tempest-GroupSnapshotsTest-914175389 None] Created volume successfully. Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Flow 'volume_create_manager' (5233f5ab-fa06-465c-a2b0-fdf6cb023f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37f4307-d998-4f20-acb1-577204b08010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37f4307-d998-4f20-acb1-577204b08010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1477525061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf032c4-230a-443f-ae27-0976db1105b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74db3523a44161aadf3218a0d655bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:37Z,use_quota=True,user_id='39c28104771c41eb85d8ea55b7bddbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5b9d98-e906-4f83-a90b-e827fb3b655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5b9d98-e906-4f83-a90b-e827fb3b655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6efbd9-2b20-449b-821d-f137a85c9abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae6efbd9-2b20-449b-821d-f137a85c9abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf032c4-230a-443f-ae27-0976db1105b2', 'volume_name': 'volume-adf032c4-230a-443f-ae27-0976db1105b2', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c22a68c-3b91-46fe-81b0-18a5cb49e922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c22a68c-3b91-46fe-81b0-18a5cb49e922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18347d91-f24c-4271-85a2-3289a47bdc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:36 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Volume adf032c4-230a-443f-ae27-0976db1105b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf032c4-230a-443f-ae27-0976db1105b2', 'volume_size': 1} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1477525061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf032c4-230a-443f-ae27-0976db1105b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad74db3523a44161aadf3218a0d655bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:37Z,use_quota=True,user_id='39c28104771c41eb85d8ea55b7bddbb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Creating volume adf032c4-230a-443f-ae27-0976db1105b2 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:20:36 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:20:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:36 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 1073741824 Sep 16 16:20:36 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] GroupSnapshot a9d59900-79a1-40a5-8924-418393cf329f: creating. Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Group snapshot a9d59900-79a1-40a5-8924-418393cf329f: creating. {{(pid=86255) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:37 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 1073741824" returned: 0 in 0.564s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:37 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 Sep 16 16:20:37 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:37 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2" returned: 0 in 0.343s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.731s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18347d91-f24c-4271-85a2-3289a47bdc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf032c4-230a-443f-ae27-0976db1105b2', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19472732-d168-4624-875f-2a4e2a103dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Creating offline snapshot 654bf915-a2c6-4778-8293-a6a3a4e13233 of volume 53b25762-f445-494c-b014-3d4854e9adf7 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:20:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Volume volume-adf032c4-230a-443f-ae27-0976db1105b2 (adf032c4-230a-443f-ae27-0976db1105b2): created successfully Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19472732-d168-4624-875f-2a4e2a103dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Flow 'volume_create_manager' (5233f5ab-fa06-465c-a2b0-fdf6cb023f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[855702bd-4c3e-4ca0-b970-d62beb025181]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-85bb4d4b-b10e-466b-9a55-a9b5483ce8b1 tempest-VolumesExtendTest-1367647781 None] Created volume successfully. Sep 16 16:20:37 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 Sep 16 16:20:37 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:38 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7" returned: 0 in 0.384s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:38 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 1G Sep 16 16:20:38 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:38 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 1G" returned: 0 in 0.551s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b25762-f445-494c-b014-3d4854e9adf7 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:38 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b25762-f445-494c-b014-3d4854e9adf7 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 Sep 16 16:20:38 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:39 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b25762-f445-494c-b014-3d4854e9adf7 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233" returned: 0 in 0.379s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:39 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:20:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:39 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 Sep 16 16:20:39 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:39 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233" returned: 0 in 0.252s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:39 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.info Sep 16 16:20:39 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:39 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.info" returned: 0 in 0.305s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:39 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 16 16:20:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:39 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.info Sep 16 16:20:39 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:40 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.info" returned: 0 in 0.497s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.255s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Creating offline snapshot d0a89b7e-13ab-42d3-943a-7a4828aa53e5 of volume adf032c4-230a-443f-ae27-0976db1105b2 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:20:40 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ff581-19b5-4ae4-afbc-767d93914d66]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-832428b6-b40c-493c-9fb8-658cc181e999 tempest-GroupSnapshotsTest-914175389 None] group_snapshot a9d59900-79a1-40a5-8924-418393cf329f: created successfully Sep 16 16:20:40 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 Sep 16 16:20:40 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:40 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2" returned: 0 in 0.546s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:40 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 1G Sep 16 16:20:40 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:41 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 1G" returned: 0 in 0.644s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf032c4-230a-443f-ae27-0976db1105b2 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:41 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf032c4-230a-443f-ae27-0976db1105b2 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 Sep 16 16:20:41 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:41 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] group_snapshot a9d59900-79a1-40a5-8924-418393cf329f: deleting Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] group_snapshot a9d59900-79a1-40a5-8924-418393cf329f: deleting {{(pid=86255) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-53b25762-f445-494c-b014-3d4854e9adf7" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-53b25762-f445-494c-b014-3d4854e9adf7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-654bf915-a2c6-4778-8293-a6a3a4e13233" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-654bf915-a2c6-4778-8293-a6a3a4e13233" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Deleting offline snapshot 654bf915-a2c6-4778-8293-a6a3a4e13233 of volume 53b25762-f445-494c-b014-3d4854e9adf7 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] snapshot_file for this snap is: volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd7d752-93bb-41c1-b902-2c2fdccc2a66]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:41 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:20:41 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:41 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 Sep 16 16:20:41 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:42 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adf032c4-230a-443f-ae27-0976db1105b2 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5" returned: 0 in 0.572s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:42 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 is being set with open permissions: ugo+rw Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:42 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.389s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:20:42 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 Sep 16 16:20:42 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:42 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233" returned: 0 in 0.506s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53b25762-f445-494c-b014-3d4854e9adf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[05594d8d-e773-442c-9e00-365140e31d0d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:42 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5" returned: 0 in 0.333s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:42 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 Sep 16 16:20:42 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:42 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.info Sep 16 16:20:42 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:42 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7" returned: 0 in 0.540s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:42 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.info" returned: 0 in 0.374s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:42 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.info is being set with open permissions: ugo+rw Sep 16 16:20:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:42 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 Sep 16 16:20:42 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:42 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.info Sep 16 16:20:42 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:43 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.info" returned: 0 in 0.562s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.209s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:43 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233" returned: 0 in 0.674s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ebbb2270-1093-4f2c-ad74-ad6cd3d10d74 tempest-VolumesExtendTest-1367647781 None] Create snapshot completed successfully Sep 16 16:20:43 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233 Sep 16 16:20:43 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-43a4b7c6-b650-4a33-a4ed-e20e959f0de3 req-5d1a6671-0239-4ac4-b6f5-96e70920c49b tempest-TestShelveInstance-392634653 None] Terminate volume connection completed successfully. Sep 16 16:20:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-43a4b7c6-b650-4a33-a4ed-e20e959f0de3 req-5d1a6671-0239-4ac4-b6f5-96e70920c49b tempest-TestShelveInstance-392634653 None] Deleting attachment 3d645983-88a4-4003-957f-e5cd0a96f959. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:20:43 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7.654bf915-a2c6-4778-8293-a6a3a4e13233" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-654bf915-a2c6-4778-8293-a6a3a4e13233" released by "_delete_snapshot" :: held 2.206s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-53b25762-f445-494c-b014-3d4854e9adf7" released by "delete_snapshot" :: held 2.235s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:44 devstack cinder-volume[86255]: WARNING cinder.quota [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-253445527 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-253445527, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:20:44 devstack cinder-volume[86255]: WARNING cinder.quota [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-253445527 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-253445527, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:20:44 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] Created reservations ['a3b059ff-007d-4d1c-a5a8-b67e683a6ee3', '18308d4d-8567-408e-bae5-51b081163c4b', 'b5185d09-62af-4b06-8d4f-a423625dee20', 'e80fa0e7-3669-4219-af0f-e234b7095daa'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3dcf9b74-c493-4b91-8a95-5443b6bc9794 tempest-GroupSnapshotsTest-914175389 None] group_snapshot a9d59900-79a1-40a5-8924-418393cf329f: deleted successfully Sep 16 16:20:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ca019633-58c8-4d7b-b3db-2beed3676f00 tempest-VolumesExtendTest-1367647781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ca019633-58c8-4d7b-b3db-2beed3676f00 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dc4d23-3358-45d6-9eaa-cb0927aaa8af]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ca019633-58c8-4d7b-b3db-2beed3676f00 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:44 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 Sep 16 16:20:44 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:45 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ca019633-58c8-4d7b-b3db-2beed3676f00 tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2" returned: 0 in 0.421s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ca019633-58c8-4d7b-b3db-2beed3676f00 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 2G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ca019633-58c8-4d7b-b3db-2beed3676f00 tempest-VolumesExtendTest-1367647781 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 2G" returned: 0 in 0.234s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ca019633-58c8-4d7b-b3db-2beed3676f00 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.726s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ca019633-58c8-4d7b-b3db-2beed3676f00 tempest-VolumesExtendTest-1367647781 None] Extend volume completed successfully. Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "cinder-quobyte-53b25762-f445-494c-b014-3d4854e9adf7" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-53b25762-f445-494c-b014-3d4854e9adf7" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5551d0a-5d97-486d-a826-659d70314a06]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:45 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 Sep 16 16:20:45 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Acquiring lock "cinder-d0a89b7e-13ab-42d3-943a-7a4828aa53e5-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Lock "cinder-d0a89b7e-13ab-42d3-943a-7a4828aa53e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Acquiring lock "cinder-quobyte-adf032c4-230a-443f-ae27-0976db1105b2" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Lock "cinder-quobyte-adf032c4-230a-443f-ae27-0976db1105b2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Acquiring lock "cinder-quobyte-d0a89b7e-13ab-42d3-943a-7a4828aa53e5" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Lock "cinder-quobyte-d0a89b7e-13ab-42d3-943a-7a4828aa53e5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Deleting offline snapshot d0a89b7e-13ab-42d3-943a-7a4828aa53e5 of volume adf032c4-230a-443f-ae27-0976db1105b2 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] snapshot_file for this snap is: volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b325e4f4-69fb-4114-bd7b-503d9ced0716]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:46 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 Sep 16 16:20:46 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:46 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7" returned: 0 in 0.564s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:46 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7 Sep 16 16:20:46 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:46 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:46 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5" returned: 0 in 0.530s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adf032c4-230a-443f-ae27-0976db1105b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-53b25762-f445-494c-b014-3d4854e9adf7" returned: 0 in 0.431s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4435f1-df6e-4aad-a6fc-2db8777579b6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Lock "cinder-quobyte-53b25762-f445-494c-b014-3d4854e9adf7" released by "delete_volume" :: held 1.110s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Created reservations ['7baac6a1-fa7b-4c9c-a620-347ecb81a9fa'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:46 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 Sep 16 16:20:46 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:46 devstack cinder-volume[86255]: WARNING cinder.quota [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-253445527 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-253445527, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Created reservations ['3dfa39bd-8aae-482a-a430-052b9ffdbc7e', 'e99b308d-04ab-4515-a397-cf2a0ee73fd4', '066181e8-7284-4eff-a2c0-44a348fc602c', 'e48d0833-61ff-4689-bb46-dfffc11d73fb'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:47 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:20:47 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-4df4f8d9-aa73-4753-b349-aad2c3d70b2f req-8fbc3472-d5ec-48c7-acc0-a166eeb1b23f tempest-TestShelveInstance-392634653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-4df4f8d9-aa73-4753-b349-aad2c3d70b2f req-8fbc3472-d5ec-48c7-acc0-a166eeb1b23f tempest-TestShelveInstance-392634653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-4df4f8d9-aa73-4753-b349-aad2c3d70b2f req-8fbc3472-d5ec-48c7-acc0-a166eeb1b23f tempest-TestShelveInstance-392634653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-4df4f8d9-aa73-4753-b349-aad2c3d70b2f req-8fbc3472-d5ec-48c7-acc0-a166eeb1b23f tempest-TestShelveInstance-392634653 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '092aec00-f82c-49a3-9d73-5656448e9ddb', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:20:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-4df4f8d9-aa73-4753-b349-aad2c3d70b2f req-8fbc3472-d5ec-48c7-acc0-a166eeb1b23f tempest-TestShelveInstance-392634653 None] attachment_update completed successfully. Sep 16 16:20:47 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2" returned: 0 in 0.588s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:47 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 Sep 16 16:20:47 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:47 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.311s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:20:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8f9a5f3c-2da4-4b96-b119-9d2818bd61cf tempest-GroupSnapshotsTest-914175389 None] Delete group completed successfully. Sep 16 16:20:47 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5" returned: 0 in 0.499s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:47 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5 Sep 16 16:20:47 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:48 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2.d0a89b7e-13ab-42d3-943a-7a4828aa53e5" returned: 0 in 0.281s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Lock "cinder-quobyte-d0a89b7e-13ab-42d3-943a-7a4828aa53e5" released by "_delete_snapshot" :: held 2.140s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Lock "cinder-quobyte-adf032c4-230a-443f-ae27-0976db1105b2" released by "delete_snapshot" :: held 2.190s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:48 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Created reservations ['5c852ace-0849-4032-a13f-be5138fcf73d', '26d1bbea-cf53-4f94-bf1f-99091eb32eac', '1734bf07-25eb-4b74-bea3-d6f2f27eddeb', '550b0482-8cc7-41c3-a8d7-93a96ff94c98'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:48 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Delete snapshot completed successfully. Sep 16 16:20:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21afda6e-3c8c-4c55-8e4c-26a5a9506ffe tempest-VolumesExtendTest-1367647781 None] Lock "cinder-d0a89b7e-13ab-42d3-943a-7a4828aa53e5-delete_snapshot" released by "delete_snapshot" :: held 2.480s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Acquiring lock "cinder-adf032c4-230a-443f-ae27-0976db1105b2-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Lock "cinder-adf032c4-230a-443f-ae27-0976db1105b2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Acquiring lock "cinder-quobyte-adf032c4-230a-443f-ae27-0976db1105b2" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:20:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Lock "cinder-quobyte-adf032c4-230a-443f-ae27-0976db1105b2" acquired by "delete_volume" :: waited 0.050s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:20:49 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aee1ead-681f-49b0-967d-b59dc0f7098f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:49 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 Sep 16 16:20:49 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:50 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2" returned: 0 in 0.477s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:50 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2 Sep 16 16:20:50 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:50 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-adf032c4-230a-443f-ae27-0976db1105b2" returned: 0 in 0.394s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Lock "cinder-quobyte-adf032c4-230a-443f-ae27-0976db1105b2" released by "delete_volume" :: held 0.989s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Created reservations ['1b4c3e50-b1d6-4de9-a748-2c51b63d0099', 'b60845c3-cbe2-49b1-93a8-c3ed4ff9595e', '2c4cc0b8-0b0d-4a98-b84a-5f268f5f1e86', '5babc3bc-c08d-4927-949f-20c345dee4d7'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:50 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:20:50 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:51 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.385s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:51 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:20:51 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Deleted volume successfully. Sep 16 16:20:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0dc3ceee-f6ef-4abe-9648-0eb79af68ed0 tempest-VolumesExtendTest-1367647781 None] Lock "cinder-adf032c4-230a-443f-ae27-0976db1105b2-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:20:52 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:20:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Flow 'volume_create_manager' (67691dde-57d2-48ad-838b-dc20d5aa536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:20:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068e7d6a-e276-41b7-bda2-c70d4a05f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068e7d6a-e276-41b7-bda2-c70d4a05f50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108a3d77-9663-45e1-a98a-9b71ebc66f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf99d5efe15493eb18b68532f0a90d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:52Z,use_quota=True,user_id='3e195198786d45478aed299f52aa13b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6014658-5156-4ed7-a609-78ed701bc86d),volume_type_id=d6014658-5156-4ed7-a609-78ed701bc86d)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dd6824-dc70-40ad-8fe9-85806a64b2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dd6824-dc70-40ad-8fe9-85806a64b2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f6bca4-0dca-4028-83c9-df0c5506ac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:52 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:20:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f6bca4-0dca-4028-83c9-df0c5506ac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '108a3d77-9663-45e1-a98a-9b71ebc66f5a', 'volume_name': 'volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a', 'volume_size': 1, 'image_id': 'b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0141108ce1071e889e970b60cbe952b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cdf99d5efe15493eb18b68532f0a90d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '490210e15f3664f74d18fe91a489ae9aa485156960e16850ebeadbda98a45fb2f5b2ebfcfb6e98ab5c4adc4fc5b4579c27a478690756701ddf2ae837a595348c', 'id': 'b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'created_at': datetime.datetime(2026, 9, 16, 14, 20, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 20, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b79c97cb-5ef5-466b-97fb-9e21072aa5cb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1637c3f-c79e-4023-b7fe-8f69294955b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1637c3f-c79e-4023-b7fe-8f69294955b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:20:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91adb20b-99ce-4763-9fee-ac98eb29ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:20:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Volume 108a3d77-9663-45e1-a98a-9b71ebc66f5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a', 'volume_size': 1, 'image_id': 'b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0141108ce1071e889e970b60cbe952b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cdf99d5efe15493eb18b68532f0a90d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '490210e15f3664f74d18fe91a489ae9aa485156960e16850ebeadbda98a45fb2f5b2ebfcfb6e98ab5c4adc4fc5b4579c27a478690756701ddf2ae837a595348c', 'id': 'b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'created_at': datetime.datetime(2026, 9, 16, 14, 20, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 20, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b79c97cb-5ef5-466b-97fb-9e21072aa5cb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 16 16:20:53 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Trying to clone 108a3d77-9663-45e1-a98a-9b71ebc66f5a from image b79c97cb-5ef5-466b-97fb-9e21072aa5cb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:20:53 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:20:53 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Image download 0.00 MB at 0.00 MB/s Sep 16 16:20:53 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad7458c-e33d-4d8c-8658-abb3dfa4051e]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:54 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD Sep 16 16:20:54 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:54 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD" returned: 0 in 0.580s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:54 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD Sep 16 16:20:54 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:55 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD" returned: 1 in 0.610s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:20:55 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Temporary image b79c97cb-5ef5-466b-97fb-9e21072aa5cb is fetched for user 3e195198786d45478aed299f52aa13b4. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:20:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d643cc2-4803-4166-a42a-f8f8bab02ac8]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:55 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD Sep 16 16:20:55 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:55 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD" returned: 0 in 0.575s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:56 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD Sep 16 16:20:56 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:56 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD" returned: 1 in 0.495s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108a3d77-9663-45e1-a98a-9b71ebc66f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdf99d5efe15493eb18b68532f0a90d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:20:52Z,use_quota=True,user_id='3e195198786d45478aed299f52aa13b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6014658-5156-4ed7-a609-78ed701bc86d),volume_type_id=d6014658-5156-4ed7-a609-78ed701bc86d)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Creating volume 108a3d77-9663-45e1-a98a-9b71ebc66f5a {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:20:56 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:20:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:56 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a 1073741824 Sep 16 16:20:56 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:57 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a 1073741824" returned: 0 in 0.643s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:57 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a Sep 16 16:20:57 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:57 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a" returned: 0 in 0.372s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:20:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:20:57 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Attempting download of b79c97cb-5ef5-466b-97fb-9e21072aa5cb ((None, [{'url': 'file:///opt/stack/data/glance/images/b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'metadata': {}}])) to volume 108a3d77-9663-45e1-a98a-9b71ebc66f5a. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:20:57 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e3439d-37b9-4a8d-b110-c8f72108601c]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_kdkwcmw7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:57 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_kdkwcmw7 Sep 16 16:20:57 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:58 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_kdkwcmw7" returned: 0 in 0.493s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_kdkwcmw7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:58 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_kdkwcmw7 Sep 16 16:20:58 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:58 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_kdkwcmw7" returned: 1 in 0.521s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_kdkwcmw7' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:20:58 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ceaf94-44e3-47d9-81af-a17dfac9618c]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:20:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:58 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD Sep 16 16:20:58 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:59 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD" returned: 0 in 0.550s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:59 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD Sep 16 16:20:59 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:20:59 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Sep 16 16:20:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD" returned: 1 in 0.585s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:20:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:20:59 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] b79c97cb-5ef5-466b-97fb-9e21072aa5cb was raw, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:20:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:20:59 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a Sep 16 16:20:59 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:00 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a" returned: 0 in 0.698s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:00 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b79c97cb-5ef5-466b-97fb-9e21072aa5cb_yo7w4476devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:21:00 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 16:21:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:00 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a 1G Sep 16 16:21:00 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:01 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a 1G" returned: 0 in 0.627s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Downloaded image b79c97cb-5ef5-466b-97fb-9e21072aa5cb ((None, [{'url': 'file:///opt/stack/data/glance/images/b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'metadata': {}}])) to volume 108a3d77-9663-45e1-a98a-9b71ebc66f5a successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Temporary image b79c97cb-5ef5-466b-97fb-9e21072aa5cb for user 3e195198786d45478aed299f52aa13b4 is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Marking volume 108a3d77-9663-45e1-a98a-9b71ebc66f5a as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Copying metadata from image b79c97cb-5ef5-466b-97fb-9e21072aa5cb to 108a3d77-9663-45e1-a98a-9b71ebc66f5a. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Creating volume glance metadata for volume 108a3d77-9663-45e1-a98a-9b71ebc66f5a backed by image b79c97cb-5ef5-466b-97fb-9e21072aa5cb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0141108ce1071e889e970b60cbe952b9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91adb20b-99ce-4763-9fee-ac98eb29ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a', 'volume_size': 1, 'image_id': 'b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0141108ce1071e889e970b60cbe952b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cdf99d5efe15493eb18b68532f0a90d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '490210e15f3664f74d18fe91a489ae9aa485156960e16850ebeadbda98a45fb2f5b2ebfcfb6e98ab5c4adc4fc5b4579c27a478690756701ddf2ae837a595348c', 'id': 'b79c97cb-5ef5-466b-97fb-9e21072aa5cb', 'created_at': datetime.datetime(2026, 9, 16, 14, 20, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 20, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b79c97cb-5ef5-466b-97fb-9e21072aa5cb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f043779a-93a0-4b06-a3ae-0273114e84d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:01 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Volume volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a (108a3d77-9663-45e1-a98a-9b71ebc66f5a): created successfully Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f043779a-93a0-4b06-a3ae-0273114e84d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Flow 'volume_create_manager' (67691dde-57d2-48ad-838b-dc20d5aa536a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:01 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1ccd0b90-bdb8-4d15-8b8c-7c1304dd7130 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Created volume successfully. Sep 16 16:21:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Acquiring lock "cinder-108a3d77-9663-45e1-a98a-9b71ebc66f5a-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "cinder-108a3d77-9663-45e1-a98a-9b71ebc66f5a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Acquiring lock "cinder-quobyte-108a3d77-9663-45e1-a98a-9b71ebc66f5a" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "cinder-quobyte-108a3d77-9663-45e1-a98a-9b71ebc66f5a" acquired by "delete_volume" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:02 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb38927-fefc-4cbc-a3a3-99ff0017a04a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:03 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a Sep 16 16:21:03 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:03 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a" returned: 0 in 0.829s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:03 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a Sep 16 16:21:03 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:04 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-108a3d77-9663-45e1-a98a-9b71ebc66f5a" returned: 0 in 0.568s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "cinder-quobyte-108a3d77-9663-45e1-a98a-9b71ebc66f5a" released by "delete_volume" :: held 1.515s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:04 devstack cinder-volume[86255]: WARNING cinder.quota [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:21:04 devstack cinder-volume[86255]: WARNING cinder.quota [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:21:04 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Created reservations ['80b0a737-193a-4107-a835-08f969dbf9e1', '01d7203c-1c20-492e-8af7-fb59090913d1', 'eee33515-f422-4239-a4a8-b7b62f5e7e80', '58d412d8-b779-400a-8521-1e401bcfaf0d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:04 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:21:04 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:05 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.515s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:05 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:21:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Deleted volume successfully. Sep 16 16:21:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1648b7a-39d0-4bd1-a20e-a0bc1b5ba825 tempest-VolumeAndVolumeTypeFromImageTest-1729017421 None] Lock "cinder-108a3d77-9663-45e1-a98a-9b71ebc66f5a-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Flow 'volume_create_manager' (ba3b3be9-3c3e-49e6-a98b-84b32a518258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b206d3a7-8ba9-4dfd-ad86-d2921a72546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b206d3a7-8ba9-4dfd-ad86-d2921a72546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-829816861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0942deb8-170a-4748-95ab-4307ea3c9d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49914cbec714ab78451aedaeef40154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:06Z,use_quota=True,user_id='f8cb9c8e81b942f6996a58de6a16d45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947fef86-f975-46f7-b997-8ba55d6fa255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947fef86-f975-46f7-b997-8ba55d6fa255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7448a507-d17d-4313-b22a-ce119f2c14e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7448a507-d17d-4313-b22a-ce119f2c14e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0942deb8-170a-4748-95ab-4307ea3c9d94', 'volume_name': 'volume-0942deb8-170a-4748-95ab-4307ea3c9d94', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2f6097-142f-4722-bf47-77699616cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2f6097-142f-4722-bf47-77699616cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0aefb2-5d32-4b54-88fb-ced813387115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Volume 0942deb8-170a-4748-95ab-4307ea3c9d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0942deb8-170a-4748-95ab-4307ea3c9d94', 'volume_size': 1} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-829816861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0942deb8-170a-4748-95ab-4307ea3c9d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49914cbec714ab78451aedaeef40154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:06Z,use_quota=True,user_id='f8cb9c8e81b942f6996a58de6a16d45b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Creating volume 0942deb8-170a-4748-95ab-4307ea3c9d94 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:21:06 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:21:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:06 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94 1073741824 Sep 16 16:21:06 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:07 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94 1073741824" returned: 0 in 0.551s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:07 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94 Sep 16 16:21:07 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:07 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94" returned: 0 in 0.534s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:21:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0aefb2-5d32-4b54-88fb-ced813387115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0942deb8-170a-4748-95ab-4307ea3c9d94', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02195a4-2f23-40e0-bb50-c5a1fcfc5dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:07 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Volume volume-0942deb8-170a-4748-95ab-4307ea3c9d94 (0942deb8-170a-4748-95ab-4307ea3c9d94): created successfully Sep 16 16:21:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02195a4-2f23-40e0-bb50-c5a1fcfc5dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Flow 'volume_create_manager' (ba3b3be9-3c3e-49e6-a98b-84b32a518258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9b53b1e1-d4b6-4952-816c-f8288c9f20af tempest-VolumesNegativeTest-1833506294 None] Created volume successfully. Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Flow 'volume_create_manager' (16485fe0-5008-4b26-bc50-24dd58a84f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e18719b-67c7-4851-8f64-e1fbe197b341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e18719b-67c7-4851-8f64-e1fbe197b341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-334559851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452bc60d-2dea-4e29-a99f-48e58c33ecae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68f8f1e248142068a9d40779c23d610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:10Z,use_quota=True,user_id='7ba33937ac18466a8143a7a4d69147b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db5be2f-566b-4633-aeb7-c44b48d03af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db5be2f-566b-4633-aeb7-c44b48d03af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd00eef8-6b89-4333-958a-f3ae9e6c1a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd00eef8-6b89-4333-958a-f3ae9e6c1a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '452bc60d-2dea-4e29-a99f-48e58c33ecae', 'volume_name': 'volume-452bc60d-2dea-4e29-a99f-48e58c33ecae', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d43a01d-cf0c-4a5e-8bb4-17a21950fa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d43a01d-cf0c-4a5e-8bb4-17a21950fa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0266a8-8042-44b1-89a5-aac741c397ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Volume 452bc60d-2dea-4e29-a99f-48e58c33ecae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-452bc60d-2dea-4e29-a99f-48e58c33ecae', 'volume_size': 1} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-334559851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452bc60d-2dea-4e29-a99f-48e58c33ecae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68f8f1e248142068a9d40779c23d610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:10Z,use_quota=True,user_id='7ba33937ac18466a8143a7a4d69147b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Creating volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:21:09 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:21:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:09 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae 1073741824 Sep 16 16:21:09 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:10 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae 1073741824" returned: 0 in 0.706s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:10 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae Sep 16 16:21:10 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:10 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae" returned: 0 in 0.407s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:21:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0266a8-8042-44b1-89a5-aac741c397ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452bc60d-2dea-4e29-a99f-48e58c33ecae', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c81634-cbe4-4773-a2d9-f0b3e4a5a492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:11 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Volume volume-452bc60d-2dea-4e29-a99f-48e58c33ecae (452bc60d-2dea-4e29-a99f-48e58c33ecae): created successfully Sep 16 16:21:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c81634-cbe4-4773-a2d9-f0b3e4a5a492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Flow 'volume_create_manager' (16485fe0-5008-4b26-bc50-24dd58a84f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:11 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f6ae1a16-27b3-4900-981d-f1e0168b693a tempest-SnapshotsActionsTest-1121597029 None] Created volume successfully. Sep 16 16:21:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Creating offline snapshot b9614c38-abc8-415a-a7df-555ab50e8bcd of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:21:12 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[68769a76-705d-4b62-8d09-bc78bf6ae8a4]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:12 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae Sep 16 16:21:12 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:12 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae" returned: 0 in 0.562s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:12 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd 1G Sep 16 16:21:12 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Flow 'volume_create_manager' (05deec50-b217-4ef6-86a8-2b717ec5d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff95ca2-f14a-4fa7-a87b-1cdf5f5c847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff95ca2-f14a-4fa7-a87b-1cdf5f5c847a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-208747739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc968d-aa8d-4bce-83c5-c4a568477dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed785f37af194076b36e56eb9e88612a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:13Z,use_quota=True,user_id='fd29f237f80b4f61ae04f78b44d676ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154e17db-e291-4bf2-a2ca-415b9b26728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154e17db-e291-4bf2-a2ca-415b9b26728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d469322-9fdb-49c2-a3bf-efa66d3afc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d469322-9fdb-49c2-a3bf-efa66d3afc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ddc968d-aa8d-4bce-83c5-c4a568477dfa', 'volume_name': 'volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd2945c-a748-4b1b-a8cd-09bcb49d4abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd2945c-a748-4b1b-a8cd-09bcb49d4abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67265ac2-7092-4c9a-b996-7b4248aa5e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:13 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Volume 6ddc968d-aa8d-4bce-83c5-c4a568477dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa', 'volume_size': 1} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:13 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd 1G" returned: 0 in 0.512s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:13 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:13 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:13 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.400s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:13 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd is being set with open permissions: ugo+rw Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:13 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:13 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:13 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.273s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:13 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.info Sep 16 16:21:13 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:14 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.info" returned: 0 in 0.288s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:14 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.info is being set with open permissions: ugo+rw Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:14 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.info Sep 16 16:21:14 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:14 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.info" returned: 0 in 0.297s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.474s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.441s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-208747739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ddc968d-aa8d-4bce-83c5-c4a568477dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed785f37af194076b36e56eb9e88612a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:13Z,use_quota=True,user_id='fd29f237f80b4f61ae04f78b44d676ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Creating volume 6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:21:14 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:21:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:14 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa 1073741824 Sep 16 16:21:14 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c5a0159c-41a7-40bb-99fb-79025c19552a tempest-SnapshotsActionsTest-1121597029 None] Create snapshot completed successfully Sep 16 16:21:15 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa 1073741824" returned: 0 in 0.568s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:15 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa Sep 16 16:21:15 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:15 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" returned: 0 in 0.626s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:21:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:15 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67265ac2-7092-4c9a-b996-7b4248aa5e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:15 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da59de35-3fbb-4b98-84be-92af7c899b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:16 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Volume volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa (6ddc968d-aa8d-4bce-83c5-c4a568477dfa): created successfully Sep 16 16:21:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da59de35-3fbb-4b98-84be-92af7c899b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Flow 'volume_create_manager' (05deec50-b217-4ef6-86a8-2b717ec5d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6d240fdc-5aa0-4e61-a4b2-baf7b0b9438c tempest-VolumeDependencyTests-307075248 None] Created volume successfully. Sep 16 16:21:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:16 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Creating offline snapshot eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:21:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:16 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3407ce-f55d-4b92-91fc-742829eb8205]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:17 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:17 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:17 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.541s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:17 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 1G Sep 16 16:21:17 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:18 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 1G" returned: 0 in 0.877s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:18 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 Sep 16 16:21:18 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:18 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:18 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 is being set with open permissions: ugo+rw Sep 16 16:21:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:18 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 Sep 16 16:21:18 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:19 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6" returned: 0 in 0.374s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.471s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.349s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Creating offline snapshot 05b59cbb-97c9-4225-9f6d-4f91a843ac2b of volume 6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:21:19 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9ae40fd6-b1db-4783-ac7b-1a7fcbd0dd50 tempest-SnapshotsActionsTest-1121597029 None] Create snapshot completed successfully Sep 16 16:21:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b6bd95-865b-409a-9894-b07fdb5cf6fe]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:19 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa Sep 16 16:21:19 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:20 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" returned: 0 in 0.981s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-eb13a8b5-b607-45f4-bbe7-51f12a5d53e6-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:20 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b 1G Sep 16 16:21:20 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-eb13a8b5-b607-45f4-bbe7-51f12a5d53e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-quobyte-eb13a8b5-b607-45f4-bbe7-51f12a5d53e6" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-eb13a8b5-b607-45f4-bbe7-51f12a5d53e6" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Deleting offline snapshot eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] snapshot_file for this snap is: volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc9e8ff-93fa-48da-9ebd-f871f77cce57]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:20 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 Sep 16 16:21:20 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:20 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b 1G" returned: 0 in 0.624s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:21 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b Sep 16 16:21:21 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:21 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6" returned: 0 in 0.458s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa1325a-509c-49ef-ab9d-ae1e4ab49be9]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:21 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:21 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:21 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b" returned: 0 in 0.383s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:21 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b is being set with open permissions: ugo+rw Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:21 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b Sep 16 16:21:21 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:21 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.553s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:21 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 Sep 16 16:21:21 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:21 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b" returned: 0 in 0.383s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:21 devstack sudo[100370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.info Sep 16 16:21:21 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:22 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.info" returned: 0 in 0.334s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:22 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.info is being set with open permissions: ugo+rw Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:22 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.info Sep 16 16:21:22 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:22 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6" returned: 0 in 0.535s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:22 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6 Sep 16 16:21:22 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:22 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.info" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.151s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e6aef714-5c02-4f4a-bb84-51f1ef223796 tempest-VolumeDependencyTests-307075248 None] Create snapshot completed successfully Sep 16 16:21:22 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.eb13a8b5-b607-45f4-bbe7-51f12a5d53e6" returned: 0 in 0.339s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-eb13a8b5-b607-45f4-bbe7-51f12a5d53e6" released by "_delete_snapshot" :: held 2.077s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" released by "delete_snapshot" :: held 2.116s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Created reservations ['91eb8ce1-d663-4a41-a07c-d196c50aaab8', '69114dad-e6e7-46b5-a5b4-e64946f13f68', '0888047a-360a-4943-8d2e-6e9183561be9', 'cb6c3af2-3ac1-42e1-8b6d-008063fa986c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Delete snapshot completed successfully. Sep 16 16:21:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b226ac8e-b1e2-4b48-94b2-b8cfe0894e12 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-eb13a8b5-b607-45f4-bbe7-51f12a5d53e6-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:23 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:21:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Flow 'volume_create_manager' (9c7aa6d0-2f1a-448b-964c-0cdd90226c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc79ae21-9ce6-4832-8331-24c8592316c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc79ae21-9ce6-4832-8331-24c8592316c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-720693048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cdee51-6a47-4f77-bdcf-6d03364d6ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed785f37af194076b36e56eb9e88612a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05b59cbb-97c9-4225-9f6d-4f91a843ac2b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:24Z,use_quota=True,user_id='fd29f237f80b4f61ae04f78b44d676ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfab3a71-882b-4f4c-bf80-2acec29cea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfab3a71-882b-4f4c-bf80-2acec29cea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fadd524-c36a-4222-8fa7-15435ba09e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fadd524-c36a-4222-8fa7-15435ba09e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2cdee51-6a47-4f77-bdcf-6d03364d6ce7', 'volume_name': 'volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7', 'volume_size': 1, 'snapshot_id': '05b59cbb-97c9-4225-9f6d-4f91a843ac2b'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d547eb3f-6ad6-4fe0-ab8e-7f5daf3b544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d547eb3f-6ad6-4fe0-ab8e-7f5daf3b544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abd6b39-96b8-4da3-b030-0e47745cbbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:24 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Volume f2cdee51-6a47-4f77-bdcf-6d03364d6ce7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7', 'volume_size': 1, 'snapshot_id': '05b59cbb-97c9-4225-9f6d-4f91a843ac2b'} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Acquiring lock "cinder-quobyte-05b59cbb-97c9-4225-9f6d-4f91a843ac2b-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" by "_create_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-05b59cbb-97c9-4225-9f6d-4f91a843ac2b-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Creating volume f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 from snapshot 05b59cbb-97c9-4225-9f6d-4f91a843ac2b {{(pid=86255) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Acquiring lock "cinder-quobyte-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] snapshot: 05b59cbb-97c9-4225-9f6d-4f91a843ac2b, volume: f2cdee51-6a47-4f77-bdcf-6d03364d6ce7, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec41026f-c352-47f3-ab46-69923122a65e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:24 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b Sep 16 16:21:24 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:24 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b" returned: 0 in 0.398s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[db403947-e40d-4fb2-a63c-678a2b110a5f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:24 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa Sep 16 16:21:24 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:25 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" returned: 0 in 0.442s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:21:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:21:25 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:21:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:25 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 Sep 16 16:21:25 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:32 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" returned: 0 in 7.081s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa, size 1024.00 MB, duration 7.08 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:21:32 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Converted 1024.00 MB image at 144.60 MB/s Sep 16 16:21:32 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 is being set with open permissions: ugo+rw Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:32 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 Sep 16 16:21:32 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:32 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" returned: 0 in 0.273s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" released by "_copy_volume_from_snapshot" :: held 8.291s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=118,cinder:INSERT=35,cinder:UPDATE=103,cinder:DELETE=6 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=103,cinder:UPDATE=113,cinder:INSERT=35,cinder:DELETE=8 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-05b59cbb-97c9-4225-9f6d-4f91a843ac2b-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" released by "_create_volume_from_snapshot" :: held 8.384s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.409s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.377s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Creating offline snapshot 01a2d198-e6cc-46a9-91cd-ffb900c76498 of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Acquiring lock "cinder-0942deb8-170a-4748-95ab-4307ea3c9d94-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abd6b39-96b8-4da3-b030-0e47745cbbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7', 'volume_size': 1, 'snapshot_id': '05b59cbb-97c9-4225-9f6d-4f91a843ac2b'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a314385-8440-41b0-bc20-72121a4c9e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[742b7bce-2f4f-46fc-9106-62b68db97084]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Lock "cinder-0942deb8-170a-4748-95ab-4307ea3c9d94-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:32 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Volume volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 (f2cdee51-6a47-4f77-bdcf-6d03364d6ce7): created successfully Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a314385-8440-41b0-bc20-72121a4c9e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Flow 'volume_create_manager' (9c7aa6d0-2f1a-448b-964c-0cdd90226c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b98684cb-0909-4715-b02d-fa6b21fa524c tempest-VolumeDependencyTests-307075248 None] Created volume successfully. Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Acquiring lock "cinder-quobyte-0942deb8-170a-4748-95ab-4307ea3c9d94" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Lock "cinder-quobyte-0942deb8-170a-4748-95ab-4307ea3c9d94" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:32 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:32 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ea4382-0a2d-4c4c-b0f1-120ca55173dd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:32 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94 Sep 16 16:21:32 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:33 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.562s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:33 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 1G Sep 16 16:21:33 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:33 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94" returned: 0 in 0.536s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:33 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94 Sep 16 16:21:33 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:33 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0942deb8-170a-4748-95ab-4307ea3c9d94" returned: 0 in 0.515s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Lock "cinder-quobyte-0942deb8-170a-4748-95ab-4307ea3c9d94" released by "delete_volume" :: held 1.127s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "cinder-05b59cbb-97c9-4225-9f6d-4f91a843ac2b-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Created reservations ['3219e6ab-6d10-4bee-9160-cbc986ea3cf7', '4c14e4b1-e3e8-4da4-b22f-320a0f51ad0e', 'f7b2d1f3-76cd-4667-9d31-40d2ca09f04a', '55e71a80-c2d4-469a-9ede-b4c656ab2ee4'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-05b59cbb-97c9-4225-9f6d-4f91a843ac2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "cinder-quobyte-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "cinder-quobyte-05b59cbb-97c9-4225-9f6d-4f91a843ac2b" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-05b59cbb-97c9-4225-9f6d-4f91a843ac2b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Deleting offline snapshot 05b59cbb-97c9-4225-9f6d-4f91a843ac2b of volume 6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] snapshot_file for this snap is: volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:21:34 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 1G" returned: 0 in 0.939s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb4def7-bd83-4675-8955-6e9c5d065c18]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:34 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 Sep 16 16:21:34 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:34 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b Sep 16 16:21:34 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:21:34 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:34 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:34 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498" returned: 0 in 0.526s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:34 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 is being set with open permissions: ugo+rw Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:34 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.450s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:21:34 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Deleted volume successfully. Sep 16 16:21:34 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 Sep 16 16:21:34 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92030dd8-cfb6-4f0a-b331-95ce37e29090 tempest-VolumesNegativeTest-1833506294 None] Lock "cinder-0942deb8-170a-4748-95ab-4307ea3c9d94-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:34 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b" returned: 0 in 0.622s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedecf45-60d0-4acf-a4af-9f971c31145f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:35 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa Sep 16 16:21:35 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:35 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498" returned: 0 in 0.513s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.819s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8571c84f-4f17-40bf-b059-ff87a1c237d4 tempest-SnapshotsActionsTest-1121597029 None] Create snapshot completed successfully Sep 16 16:21:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-4056dc07-32fe-47c9-a91a-6e6657fc03c6 tempest-TestShelveInstance-392634653 None] Terminate volume connection completed successfully. Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-4056dc07-32fe-47c9-a91a-6e6657fc03c6 tempest-TestShelveInstance-392634653 None] Deleting attachment 092aec00-f82c-49a3-9d73-5656448e9ddb. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Acquiring lock "cinder-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Lock "cinder-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:35 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" returned: 0 in 0.956s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:35 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b Sep 16 16:21:35 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Acquiring lock "cinder-quobyte-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Lock "cinder-quobyte-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa" acquired by "delete_volume" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5d30c5-adb6-4e9f-981a-56d2249a9635]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-01a2d198-e6cc-46a9-91cd-ffb900c76498-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-01a2d198-e6cc-46a9-91cd-ffb900c76498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-quobyte-01a2d198-e6cc-46a9-91cd-ffb900c76498" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:36 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa Sep 16 16:21:36 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-01a2d198-e6cc-46a9-91cd-ffb900c76498" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Deleting offline snapshot 01a2d198-e6cc-46a9-91cd-ffb900c76498 of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] snapshot_file for this snap is: volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f8901-013c-4db5-8134-f49954a89c35]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:36 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b" returned: 0 in 0.596s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:36 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 Sep 16 16:21:36 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:36 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b Sep 16 16:21:36 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:36 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa" returned: 0 in 0.716s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:36 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa Sep 16 16:21:36 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:36 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa.05b59cbb-97c9-4225-9f6d-4f91a843ac2b" returned: 0 in 0.389s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:36 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498" returned: 0 in 0.536s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc6551f-b2db-4d5f-b243-f4ac383a9c6d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-05b59cbb-97c9-4225-9f6d-4f91a843ac2b" released by "_delete_snapshot" :: held 2.774s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" released by "delete_snapshot" :: held 2.820s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:36 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Created reservations ['96911cf4-530e-407e-8b41-69d473de1e27', '796dfedd-d4fe-41fc-82b4-b5c0a81dc1ce', 'edf56a6f-3d71-48ef-9d1b-443e8239723e', '9f2050c5-5313-4998-90b5-aaf863a83a79'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa" returned: 0 in 0.326s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Lock "cinder-quobyte-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa" released by "delete_volume" :: held 1.111s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:37 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:37 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.quota [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Created reservations ['47e54974-0caf-4b4a-9991-60e8b7b1ab52', '04546488-3ce7-4ffd-bb8d-b68a51c00373', 'd36617de-733b-4ad4-9809-6f1e056a8071', '6d421a90-90d6-4381-831d-768f7f9a1eb8'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Delete snapshot completed successfully. Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0fbaee0-d9ea-4ce4-a51e-0ca8e5562965 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-05b59cbb-97c9-4225-9f6d-4f91a843ac2b-delete_snapshot" released by "delete_snapshot" :: held 3.138s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:37 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:21:37 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "cinder-6ddc968d-aa8d-4bce-83c5-c4a568477dfa-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-6ddc968d-aa8d-4bce-83c5-c4a568477dfa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "cinder-quobyte-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:37 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.693s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eee9dd-3dea-40ea-b4cb-971e2803aec5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:37 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 Sep 16 16:21:37 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.398s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.manager [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:21:37 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Deleted volume successfully. Sep 16 16:21:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [req-ce01040e-dd0b-4e78-9274-d6c19e0f44c2 req-82686c9e-7373-4375-a0dd-8f96c8d75ea2 tempest-TestShelveInstance-392634653 None] Lock "cinder-0b7a3166-e65f-4cdf-878f-fd8d2ff96ffa-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:37 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa Sep 16 16:21:37 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:38 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" returned: 0 in 0.518s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:38 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa Sep 16 16:21:38 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:38 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498" returned: 0 in 0.611s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:38 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498 Sep 16 16:21:38 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:38 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" returned: 0 in 0.349s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-6ddc968d-aa8d-4bce-83c5-c4a568477dfa" released by "delete_volume" :: held 0.994s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:38 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.01a2d198-e6cc-46a9-91cd-ffb900c76498" returned: 0 in 0.370s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-01a2d198-e6cc-46a9-91cd-ffb900c76498" released by "_delete_snapshot" :: held 2.395s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" released by "delete_snapshot" :: held 2.470s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Created reservations ['e6ae2293-20b8-45f7-8fbf-7736d93ac0db', 'c8289e6d-ccf3-4235-9da9-5d67479cfdf5', '83f972b6-b9c6-4892-95fe-dcb6baa5f2bf', '53b1e8de-69df-476b-a8b3-13b2f3793342'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Created reservations ['153c4231-7a81-4841-b035-946684abb353', 'c57c2450-6c9d-4d5c-90b1-ffe5a14b9750', 'e656ea3a-9e91-4c12-90d0-a56cc373e8d2', 'ab1f6213-1b31-424c-9a96-2bb1bed2a5e1'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:38 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:21:38 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Delete snapshot completed successfully. Sep 16 16:21:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b406a43-3e4b-4b37-8917-30c43bdf4f29 tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-01a2d198-e6cc-46a9-91cd-ffb900c76498-delete_snapshot" released by "delete_snapshot" :: held 2.748s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:39 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.295s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:21:39 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Deleted volume successfully. Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9d1f0f55-cd81-4237-aec0-d8faa9af45c4 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-6ddc968d-aa8d-4bce-83c5-c4a568477dfa-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "cinder-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "cinder-quobyte-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc8ea3f-ade4-46be-ad04-fe5c837b8096]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Creating offline snapshot 54464190-51c9-4c80-aac8-427cba69e4ec of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:21:40 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaedae9d-ee27-4496-8a26-da6324199a4c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:40 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:40 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:40 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:40 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" returned: 0 in 0.500s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:40 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7 Sep 16 16:21:40 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:40 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.491s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:40 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec 1G Sep 16 16:21:40 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:40 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" returned: 0 in 0.402s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-quobyte-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7" released by "delete_volume" :: held 0.983s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:40 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Created reservations ['1afa2ca2-e01c-4f0d-8790-117191f5f7c9', 'bf8f506d-e063-4a79-8462-7999bc85aca7', 'c332d0cf-4bdf-46ba-ae9a-e210398a995c', '28dab297-5aeb-4bfd-b77d-74ba774f4e5e'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:41 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:21:41 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:41 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec 1G" returned: 0 in 0.691s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:41 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec Sep 16 16:21:41 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:41 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.414s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:21:41 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Deleted volume successfully. Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2ecf187f-a7ae-491a-8d80-2af583db0334 tempest-VolumeDependencyTests-307075248 None] Lock "cinder-f2cdee51-6a47-4f77-bdcf-6d03364d6ce7-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:41 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec" returned: 0 in 0.448s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:41 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec is being set with open permissions: ugo+rw Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:41 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec Sep 16 16:21:41 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:41 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:21:41 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:42 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec" returned: 0 in 0.352s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:42 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.320s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:21:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:21:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:21:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:21:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b438529c-eebb-4526-a285-94db622754b9 tempest-SnapshotsActionsTest-1121597029 None] Create snapshot completed successfully Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-54464190-51c9-4c80-aac8-427cba69e4ec-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-54464190-51c9-4c80-aac8-427cba69e4ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-quobyte-54464190-51c9-4c80-aac8-427cba69e4ec" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-54464190-51c9-4c80-aac8-427cba69e4ec" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Deleting offline snapshot 54464190-51c9-4c80-aac8-427cba69e4ec of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] snapshot_file for this snap is: volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ab7001-8749-407d-9f61-8f1c40510335]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:43 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec Sep 16 16:21:43 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:43 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec" returned: 0 in 0.465s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0583a8-6bd1-4674-bfc6-fb1ae8fecf4d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:44 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:44 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:44 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.465s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:44 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec Sep 16 16:21:44 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:44 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec" returned: 0 in 0.507s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:44 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec Sep 16 16:21:44 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:45 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.54464190-51c9-4c80-aac8-427cba69e4ec" returned: 0 in 0.313s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-54464190-51c9-4c80-aac8-427cba69e4ec" released by "_delete_snapshot" :: held 1.942s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" released by "delete_snapshot" :: held 1.973s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:45 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Created reservations ['b5ac7882-5531-4724-b841-ac94fb6f28ec', '2796afea-a052-470c-89ba-f9022d9db31a', '83dfc817-4908-423c-bbf9-d274b733235d', 'bfcefdcc-e561-4d9e-a66b-672114198807'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Delete snapshot completed successfully. Sep 16 16:21:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b68fc326-b79d-4ff3-aea6-751901c0ec1b tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-54464190-51c9-4c80-aac8-427cba69e4ec-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Creating offline snapshot 74704888-5dc8-485f-b656-4eae4d3aa668 of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:21:47 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbfdc9d-4cc1-4282-b214-cae3a6535688]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:47 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:47 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:47 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.500s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:47 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 1G Sep 16 16:21:47 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:48 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 1G" returned: 0 in 0.793s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:48 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 Sep 16 16:21:48 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:48 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668" returned: 0 in 0.486s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:48 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 is being set with open permissions: ugo+rw Sep 16 16:21:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:49 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 Sep 16 16:21:49 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:49 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668" returned: 0 in 0.455s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-71bcb332-2dec-4860-ad89-9c259fa06b25 tempest-SnapshotsActionsTest-1121597029 None] Create snapshot completed successfully Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-74704888-5dc8-485f-b656-4eae4d3aa668-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-74704888-5dc8-485f-b656-4eae4d3aa668-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Acquiring lock "cinder-quobyte-74704888-5dc8-485f-b656-4eae4d3aa668" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-74704888-5dc8-485f-b656-4eae4d3aa668" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Deleting offline snapshot 74704888-5dc8-485f-b656-4eae4d3aa668 of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] snapshot_file for this snap is: volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5460af-7e7d-486a-8d54-2295d4b55431]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:50 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 Sep 16 16:21:50 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:51 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668" returned: 0 in 0.680s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e75ac5-f23c-4088-b2ca-d7b2ae83ada7]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:51 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:51 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Flow 'volume_create_manager' (8d3101b4-1214-4942-8675-dffa9b4d0e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3874d321-688a-4304-8e02-9a6ec763e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3874d321-688a-4304-8e02-9a6ec763e151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b65743-81b7-4b76-b93a-e20e1c575a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d852dd1a3cd3418cabe1a5bd5a837745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:51Z,use_quota=True,user_id='a127f84a8caa4587b6ae5b740b9f0c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c9a607-317c-4b93-8523-ffbf7dcfb299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c9a607-317c-4b93-8523-ffbf7dcfb299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f27402c-7c03-437b-b9aa-eb26d6ccedd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f27402c-7c03-437b-b9aa-eb26d6ccedd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85b65743-81b7-4b76-b93a-e20e1c575a17', 'volume_name': 'volume-85b65743-81b7-4b76-b93a-e20e1c575a17', 'volume_size': 1, 'image_id': '8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'feba7dfdcf696d02a40c13d32b3d8f0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd852dd1a3cd3418cabe1a5bd5a837745', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b3ae0cf87c8aec38752bc9135e1b0819b92af8f76f58027904cfb7c98d2bc828b55d7fa7d610324d115683bb0330752320878de5c8a76c8fe30dae5e78c36f87', 'id': '8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'created_at': datetime.datetime(2026, 9, 16, 14, 21, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 21, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a9bb07f-db63-4e81-bb2d-8f54a98264fd/file', 'properties': {}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3140293-e1f4-4735-b115-cbd100f7ec5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3140293-e1f4-4735-b115-cbd100f7ec5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21dd1c1c-2d53-4aca-a15c-25674de69849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:51 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Volume 85b65743-81b7-4b76-b93a-e20e1c575a17: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85b65743-81b7-4b76-b93a-e20e1c575a17', 'volume_size': 1, 'image_id': '8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'feba7dfdcf696d02a40c13d32b3d8f0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd852dd1a3cd3418cabe1a5bd5a837745', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b3ae0cf87c8aec38752bc9135e1b0819b92af8f76f58027904cfb7c98d2bc828b55d7fa7d610324d115683bb0330752320878de5c8a76c8fe30dae5e78c36f87', 'id': '8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'created_at': datetime.datetime(2026, 9, 16, 14, 21, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 21, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a9bb07f-db63-4e81-bb2d-8f54a98264fd/file', 'properties': {}}, 'image_service': } Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Trying to clone 85b65743-81b7-4b76-b93a-e20e1c575a17 from image 8a9bb07f-db63-4e81-bb2d-8f54a98264fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:21:51 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.675s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:52 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 Sep 16 16:21:52 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:21:52 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Image download 0.00 MB at 0.00 MB/s Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e674facc-0ad1-49e5-9358-816aa716c2b9]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:52 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD Sep 16 16:21:52 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:52 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668" returned: 0 in 0.604s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:52 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668 Sep 16 16:21:52 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:52 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD" returned: 0 in 0.501s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:52 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD Sep 16 16:21:52 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:52 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.74704888-5dc8-485f-b656-4eae4d3aa668" returned: 0 in 0.262s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-74704888-5dc8-485f-b656-4eae4d3aa668" released by "_delete_snapshot" :: held 2.381s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" released by "delete_snapshot" :: held 2.411s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:52 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Created reservations ['f88ba7fc-a8b1-4512-9ac4-11262953b9b8', '57a028f0-472e-4062-9f8d-158970682953', '2ba87d95-1b2b-4f02-ab44-8523b4b1122f', '8af87caf-a4c5-4502-8236-de2c2d73af2c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:53 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Temporary image 8a9bb07f-db63-4e81-bb2d-8f54a98264fd is fetched for user a127f84a8caa4587b6ae5b740b9f0c17. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:21:53 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Delete snapshot completed successfully. Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8dd1b55-4e70-44a3-a40b-f9f3bdd16d4a tempest-SnapshotsActionsTest-1844010733 None] Lock "cinder-74704888-5dc8-485f-b656-4eae4d3aa668-delete_snapshot" released by "delete_snapshot" :: held 2.644s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[09be426e-7dc3-498f-8166-2027c96688be]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:53 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD Sep 16 16:21:53 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:21:53 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (75f3bc7e-ea5b-467b-a5e2-636657b19e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b066288-1c34-4a47-98a6-1d536bd01eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b066288-1c34-4a47-98a6-1d536bd01eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1937325871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5885f277-4aad-4e0f-a068-0efc7760c7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eff84b4fc594afc8248ba23bdcc9953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:53Z,use_quota=True,user_id='d6283d20a02d448995a3aa0c87249278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35342a40-7b35-4970-afc6-bce57f682f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35342a40-7b35-4970-afc6-bce57f682f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a71df7-ffd9-453c-9c22-efd5e447b300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a71df7-ffd9-453c-9c22-efd5e447b300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5885f277-4aad-4e0f-a068-0efc7760c7fb', 'volume_name': 'volume-5885f277-4aad-4e0f-a068-0efc7760c7fb', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190fb7a3-ac25-488a-9bbb-373c03118c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (190fb7a3-ac25-488a-9bbb-373c03118c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3296145-99bd-45b5-aacd-11be2c807170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Volume 5885f277-4aad-4e0f-a068-0efc7760c7fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5885f277-4aad-4e0f-a068-0efc7760c7fb', 'volume_size': 1} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1937325871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5885f277-4aad-4e0f-a068-0efc7760c7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eff84b4fc594afc8248ba23bdcc9953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:53Z,use_quota=True,user_id='d6283d20a02d448995a3aa0c87249278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Creating volume 5885f277-4aad-4e0f-a068-0efc7760c7fb {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:21:53 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:53 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD Sep 16 16:21:53 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:53 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb 1073741824 Sep 16 16:21:53 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:53 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD" returned: 1 in 0.405s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:21:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "cinder-b9614c38-abc8-415a-a7df-555ab50e8bcd-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-b9614c38-abc8-415a-a7df-555ab50e8bcd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "cinder-quobyte-b9614c38-abc8-415a-a7df-555ab50e8bcd" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-quobyte-b9614c38-abc8-415a-a7df-555ab50e8bcd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Deleting offline snapshot b9614c38-abc8-415a-a7df-555ab50e8bcd of volume 452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] snapshot_file for this snap is: volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:21:54 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb 1073741824" returned: 0 in 0.640s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7850cf7b-a0eb-44b5-937a-1c6b6564e1d5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:54 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb Sep 16 16:21:54 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:54 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:54 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:54 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb" returned: 0 in 0.337s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b65743-81b7-4b76-b93a-e20e1c575a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d852dd1a3cd3418cabe1a5bd5a837745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:21:51Z,use_quota=True,user_id='a127f84a8caa4587b6ae5b740b9f0c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Creating volume 85b65743-81b7-4b76-b93a-e20e1c575a17 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:21:54 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:54 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.462s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-452bc60d-2dea-4e29-a99f-48e58c33ecae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:21:54 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 1073741824 Sep 16 16:21:54 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3296145-99bd-45b5-aacd-11be2c807170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5885f277-4aad-4e0f-a068-0efc7760c7fb', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437ea822-835e-4997-99ac-9f82eb360187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[015775e2-16d1-4e91-aed9-9d3202d02817]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:54 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Volume volume-5885f277-4aad-4e0f-a068-0efc7760c7fb (5885f277-4aad-4e0f-a068-0efc7760c7fb): created successfully Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (437ea822-835e-4997-99ac-9f82eb360187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (75f3bc7e-ea5b-467b-a5e2-636657b19e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:54 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5a1090f5-25c9-40a3-a2de-0a6dd9b75b43 tempest-VolumesSnapshotTestJSON-785247227 None] Created volume successfully. Sep 16 16:21:55 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae Sep 16 16:21:55 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:55 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae" returned: 0 in 0.489s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:55 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 1073741824" returned: 0 in 0.603s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:55 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:55 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:55 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 Sep 16 16:21:55 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:55 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17" returned: 0 in 0.383s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Attempting download of 8a9bb07f-db63-4e81-bb2d-8f54a98264fd ((None, [{'url': 'file:///opt/stack/data/glance/images/8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'metadata': {}}])) to volume 85b65743-81b7-4b76-b93a-e20e1c575a17. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:21:55 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.528s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:55 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd Sep 16 16:21:55 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f49c27f-d573-4937-adce-8f3efee11055]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_mw9p783l {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:56 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_mw9p783l Sep 16 16:21:56 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Creating offline snapshot 01982c5d-5757-41f9-b766-3af2b15670fd of volume 5885f277-4aad-4e0f-a068-0efc7760c7fb {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdd25f9-8b6e-4fa8-98e0-97977fd9dd52]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:56 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae.b9614c38-abc8-415a-a7df-555ab50e8bcd" returned: 0 in 0.402s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-quobyte-b9614c38-abc8-415a-a7df-555ab50e8bcd" released by "_delete_snapshot" :: held 2.082s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" released by "delete_snapshot" :: held 2.105s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:56 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb Sep 16 16:21:56 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Created reservations ['93ad0f51-b86b-4fc5-8968-3301a4ff915e', 'a7f4e327-a73b-41f8-ba1b-81e5050669e9', '791d82b6-8091-48aa-8ea9-a556916c5ca1', '9b0a2ab8-3466-4e56-b9dd-0573f2f8c1a9'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:56 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_mw9p783l" returned: 0 in 0.534s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_mw9p783l {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:56 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Delete snapshot completed successfully. Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7199419b-3411-4f7b-9426-83cb9c0c3bd3 tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-b9614c38-abc8-415a-a7df-555ab50e8bcd-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:56 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_mw9p783l Sep 16 16:21:56 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:56 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:56 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd 1G Sep 16 16:21:56 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:56 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_mw9p783l" returned: 1 in 0.464s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_mw9p783l' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b7d3a8-c1e9-4de4-90e9-3f0b580a6cd0]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:57 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD Sep 16 16:21:57 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:57 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd 1G" returned: 0 in 0.517s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5885f277-4aad-4e0f-a068-0efc7760c7fb -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:57 devstack sudo[100753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5885f277-4aad-4e0f-a068-0efc7760c7fb -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd Sep 16 16:21:57 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:57 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:57 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD Sep 16 16:21:57 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "cinder-452bc60d-2dea-4e29-a99f-48e58c33ecae-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-452bc60d-2dea-4e29-a99f-48e58c33ecae-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:57 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5885f277-4aad-4e0f-a068-0efc7760c7fb -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd" returned: 0 in 0.471s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:57 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd is being set with open permissions: ugo+rw Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:57 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd Sep 16 16:21:57 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:57 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD" returned: 1 in 0.450s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] 8a9bb07f-db63-4e81-bb2d-8f54a98264fd was raw, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec8bca-9d27-46d1-8c22-72d5026bdc43]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:57 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 Sep 16 16:21:57 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:57 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae Sep 16 16:21:57 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:58 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd" returned: 0 in 0.334s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:58 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.info Sep 16 16:21:58 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:58 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae" returned: 0 in 0.473s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:58 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae Sep 16 16:21:58 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:58 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.info" returned: 0 in 0.363s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:58 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.info is being set with open permissions: ugo+rw Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:58 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17" returned: 0 in 0.662s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a9bb07f-db63-4e81-bb2d-8f54a98264fd_3k0nhsk3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:21:58 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:58 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.info Sep 16 16:21:58 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:58 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 1G Sep 16 16:21:58 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:58 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-452bc60d-2dea-4e29-a99f-48e58c33ecae" returned: 0 in 0.381s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-quobyte-452bc60d-2dea-4e29-a99f-48e58c33ecae" released by "delete_volume" :: held 0.976s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:58 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Created reservations ['1d225e3f-cabe-45f7-a7fe-1284dfdb4e09', '03c4e943-058d-4743-864a-086fbee955d1', '3a623f17-2a22-4d43-a97a-95ceac51c2f9', '51109edd-24f6-49b9-addb-96a41b1426de'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.info" returned: 0 in 0.366s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:58 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 1G" returned: 0 in 0.427s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Downloaded image 8a9bb07f-db63-4e81-bb2d-8f54a98264fd ((None, [{'url': 'file:///opt/stack/data/glance/images/8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'metadata': {}}])) to volume 85b65743-81b7-4b76-b93a-e20e1c575a17 successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Temporary image 8a9bb07f-db63-4e81-bb2d-8f54a98264fd for user a127f84a8caa4587b6ae5b740b9f0c17 is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:21:58 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Marking volume 85b65743-81b7-4b76-b93a-e20e1c575a17 as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:21:59 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-75c9d946-d407-441f-8929-254a6d4f3573 tempest-VolumesSnapshotTestJSON-785247227 None] Create snapshot completed successfully Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Copying metadata from image 8a9bb07f-db63-4e81-bb2d-8f54a98264fd to 85b65743-81b7-4b76-b93a-e20e1c575a17. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Creating volume glance metadata for volume 85b65743-81b7-4b76-b93a-e20e1c575a17 backed by image 8a9bb07f-db63-4e81-bb2d-8f54a98264fd with: {'image_id': '8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'feba7dfdcf696d02a40c13d32b3d8f0e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:59 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:21:59 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21dd1c1c-2d53-4aca-a15c-25674de69849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b65743-81b7-4b76-b93a-e20e1c575a17', 'volume_size': 1, 'image_id': '8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'feba7dfdcf696d02a40c13d32b3d8f0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd852dd1a3cd3418cabe1a5bd5a837745', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b3ae0cf87c8aec38752bc9135e1b0819b92af8f76f58027904cfb7c98d2bc828b55d7fa7d610324d115683bb0330752320878de5c8a76c8fe30dae5e78c36f87', 'id': '8a9bb07f-db63-4e81-bb2d-8f54a98264fd', 'created_at': datetime.datetime(2026, 9, 16, 14, 21, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 21, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a9bb07f-db63-4e81-bb2d-8f54a98264fd/file', 'properties': {}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3843807a-454b-43d6-a667-f3b166edf116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:21:59 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Volume volume-85b65743-81b7-4b76-b93a-e20e1c575a17 (85b65743-81b7-4b76-b93a-e20e1c575a17): created successfully Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3843807a-454b-43d6-a667-f3b166edf116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Flow 'volume_create_manager' (8d3101b4-1214-4942-8675-dffa9b4d0e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:21:59 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6ef3afc0-5b4c-4747-a0d8-1e47c3386ce4 tempest-VolumeImageDependencyTests-490251113 None] Created volume successfully. Sep 16 16:21:59 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.297s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:21:59 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Deleted volume successfully. Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dcb95357-417d-4996-9954-81220acc47dc tempest-SnapshotsActionsTest-1121597029 None] Lock "cinder-452bc60d-2dea-4e29-a99f-48e58c33ecae-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-01982c5d-5757-41f9-b766-3af2b15670fd-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-01982c5d-5757-41f9-b766-3af2b15670fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-5885f277-4aad-4e0f-a068-0efc7760c7fb" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-5885f277-4aad-4e0f-a068-0efc7760c7fb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-01982c5d-5757-41f9-b766-3af2b15670fd" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-01982c5d-5757-41f9-b766-3af2b15670fd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Deleting offline snapshot 01982c5d-5757-41f9-b766-3af2b15670fd of volume 5885f277-4aad-4e0f-a068-0efc7760c7fb {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] snapshot_file for this snap is: volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8487e17-637f-43f9-9dbc-9264441985e8]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:21:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:21:59 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd Sep 16 16:21:59 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:00 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd" returned: 0 in 0.454s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5885f277-4aad-4e0f-a068-0efc7760c7fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e08a87-4461-4c08-8d59-374a3c86a7be]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:00 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb Sep 16 16:22:00 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Acquiring lock "cinder-85b65743-81b7-4b76-b93a-e20e1c575a17-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Lock "cinder-85b65743-81b7-4b76-b93a-e20e1c575a17-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Acquiring lock "cinder-quobyte-85b65743-81b7-4b76-b93a-e20e1c575a17" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Lock "cinder-quobyte-85b65743-81b7-4b76-b93a-e20e1c575a17" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee60a98-d037-420d-b5c7-525f4884c8c9]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:00 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 Sep 16 16:22:00 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:00 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb" returned: 0 in 0.591s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:00 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd Sep 16 16:22:00 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (fb888cf7-2ee7-4c90-b219-5d133ea5ef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4da067-e9a0-4095-89e2-5c3e053f8bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4da067-e9a0-4095-89e2-5c3e053f8bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-649668679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81d3f50-0c32-47f3-adfa-f680883332db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:01Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:00 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b3d554-a312-4616-aa55-9e2371ad0557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b3d554-a312-4616-aa55-9e2371ad0557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2e4b27-de8e-42ac-9633-aaf5b733b8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2e4b27-de8e-42ac-9633-aaf5b733b8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81d3f50-0c32-47f3-adfa-f680883332db', 'volume_name': 'volume-f81d3f50-0c32-47f3-adfa-f680883332db', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2b49b3-4ea8-440c-badd-e819b9c3e419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2b49b3-4ea8-440c-badd-e819b9c3e419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34cf9d3-f462-4511-ad6e-a4b8d8f45ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:01 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume f81d3f50-0c32-47f3-adfa-f680883332db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81d3f50-0c32-47f3-adfa-f680883332db', 'volume_size': 1} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-649668679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81d3f50-0c32-47f3-adfa-f680883332db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:01Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Creating volume f81d3f50-0c32-47f3-adfa-f680883332db {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:01 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17" returned: 0 in 0.574s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:01 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db 1073741824 Sep 16 16:22:01 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:01 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17 Sep 16 16:22:01 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:01 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd" returned: 0 in 0.483s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:01 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd Sep 16 16:22:01 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:01 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-85b65743-81b7-4b76-b93a-e20e1c575a17" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Lock "cinder-quobyte-85b65743-81b7-4b76-b93a-e20e1c575a17" released by "delete_volume" :: held 0.970s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Created reservations ['b6e63d3e-ed42-471c-90b1-c1f0b51321dd', '346ebb8b-30e0-4dcb-8356-feec6a19e0eb', 'e600bfec-1492-4b78-b569-09e0b7561a51', 'f0b64d0b-788a-4890-bc41-525d355f808a'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:01 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb.01982c5d-5757-41f9-b766-3af2b15670fd" returned: 0 in 0.402s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:01 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:01 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:01 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db 1073741824" returned: 0 in 0.708s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-01982c5d-5757-41f9-b766-3af2b15670fd" released by "_delete_snapshot" :: held 2.117s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-5885f277-4aad-4e0f-a068-0efc7760c7fb" released by "delete_snapshot" :: held 2.150s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:01 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db Sep 16 16:22:01 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Created reservations ['22257a1a-84ea-434b-93f6-e82bbe19061d', '3150a71d-fdf1-4299-960c-266829193b3e', '389f45be-4c2c-4bd4-9bee-4710f3afa9fa', '546433de-b95d-44da-8e4a-a008decf0516'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:01 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Delete snapshot completed successfully. Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0eb894c5-2211-47e9-bb46-b1e42b1b00b9 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-01982c5d-5757-41f9-b766-3af2b15670fd-delete_snapshot" released by "delete_snapshot" :: held 2.373s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:01 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.333s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:01 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:02 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Deleted volume successfully. Sep 16 16:22:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-69e5ce00-8090-475c-a79c-17bd5caa0549 tempest-VolumeImageDependencyTests-490251113 None] Lock "cinder-85b65743-81b7-4b76-b93a-e20e1c575a17-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:02 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db" returned: 0 in 0.339s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:02 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34cf9d3-f462-4511-ad6e-a4b8d8f45ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81d3f50-0c32-47f3-adfa-f680883332db', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24532d4a-d008-4174-8ea4-feb4bdd0bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:02 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume volume-f81d3f50-0c32-47f3-adfa-f680883332db (f81d3f50-0c32-47f3-adfa-f680883332db): created successfully Sep 16 16:22:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24532d4a-d008-4174-8ea4-feb4bdd0bee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (fb888cf7-2ee7-4c90-b219-5d133ea5ef30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:02 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9fe453ea-e38c-4d2e-b869-9b3767cf1723 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created volume successfully. Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (8feccb21-145e-4256-a6ee-b0e841e2856e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bd4240-8c5d-4b6f-a617-3d081530fe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bd4240-8c5d-4b6f-a617-3d081530fe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-671113334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f981965-12b8-4e68-ad30-2d6d7b287c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eff84b4fc594afc8248ba23bdcc9953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:03Z,use_quota=True,user_id='d6283d20a02d448995a3aa0c87249278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156daa6c-0b4f-4d95-8a27-79d951717ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156daa6c-0b4f-4d95-8a27-79d951717ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8344e327-9026-49f4-9425-e1f76141be93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8344e327-9026-49f4-9425-e1f76141be93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f981965-12b8-4e68-ad30-2d6d7b287c7b', 'volume_name': 'volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a8ddba-69b3-4ed8-a94a-203d1ac802cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a8ddba-69b3-4ed8-a94a-203d1ac802cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c12d68-0dd4-466f-8d55-308c8a17fdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:03 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Volume 1f981965-12b8-4e68-ad30-2d6d7b287c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b', 'volume_size': 1} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-671113334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f981965-12b8-4e68-ad30-2d6d7b287c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eff84b4fc594afc8248ba23bdcc9953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:03Z,use_quota=True,user_id='d6283d20a02d448995a3aa0c87249278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Creating volume 1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:03 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:03 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b 1073741824 Sep 16 16:22:03 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:03 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (2ff73e4b-84a5-4a7f-ba85-ab8436471c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605359ce-0b18-41fd-b6b1-5c662dade397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605359ce-0b18-41fd-b6b1-5c662dade397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2108909249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6563f4-d38f-47f3-a883-0252bed95a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:04Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141fff41-aa03-43d1-9a83-e20957885e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141fff41-aa03-43d1-9a83-e20957885e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bac8e0c-42fa-4987-85c0-d637a6de6fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bac8e0c-42fa-4987-85c0-d637a6de6fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6563f4-d38f-47f3-a883-0252bed95a26', 'volume_name': 'volume-ee6563f4-d38f-47f3-a883-0252bed95a26', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67e7a7f-8a9c-4273-b94a-a549a91cbcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d67e7a7f-8a9c-4273-b94a-a549a91cbcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d7612f-083d-44e1-b99b-135bce635ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume ee6563f4-d38f-47f3-a883-0252bed95a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6563f4-d38f-47f3-a883-0252bed95a26', 'volume_size': 1} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (0951f958-f910-43a6-9f54-54fa627656e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7787c8-9ebf-4cab-affc-5198988e0458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b 1073741824" returned: 0 in 0.669s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7787c8-9ebf-4cab-affc-5198988e0458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1294035204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36b17ea-d8a1-4be4-9dac-3606e4eb5cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:04Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4645b068-59b4-4ce0-bdd0-bba1e372150e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4645b068-59b4-4ce0-bdd0-bba1e372150e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db91ef8-9cbc-401c-bd03-f9d3e9839721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db91ef8-9cbc-401c-bd03-f9d3e9839721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e36b17ea-d8a1-4be4-9dac-3606e4eb5cde', 'volume_name': 'volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f3edd7-beb5-4eac-97d3-155e4189a5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f3edd7-beb5-4eac-97d3-155e4189a5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a935b36-b97d-4bb0-b264-fa1aa2abe628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:04 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume e36b17ea-d8a1-4be4-9dac-3606e4eb5cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde', 'volume_size': 1} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:04 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b Sep 16 16:22:04 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:04 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b" returned: 0 in 0.356s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2108909249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6563f4-d38f-47f3-a883-0252bed95a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:04Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Creating volume ee6563f4-d38f-47f3-a883-0252bed95a26 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:04 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c12d68-0dd4-466f-8d55-308c8a17fdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26 1073741824 Sep 16 16:22:05 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4864bbb-f7d3-4a9e-a38b-66654c72b2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Volume volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b (1f981965-12b8-4e68-ad30-2d6d7b287c7b): created successfully Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4864bbb-f7d3-4a9e-a38b-66654c72b2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (8feccb21-145e-4256-a6ee-b0e841e2856e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-27ba1df9-4bc8-4bac-9f88-cda564dbe28f tempest-VolumesSnapshotTestJSON-785247227 None] Created volume successfully. Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (4334c647-5fa6-4946-bf84-821a41f522f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e009eb-1437-42ac-af73-02cb0ee2cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e009eb-1437-42ac-af73-02cb0ee2cfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303218502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa25c246-9c03-407c-81bf-7ed8bb709601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:05Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b9b02d-5363-47e2-9571-6d6ec4aa6988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b9b02d-5363-47e2-9571-6d6ec4aa6988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7ae9bd-1080-459b-973f-931acffb0f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7ae9bd-1080-459b-973f-931acffb0f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa25c246-9c03-407c-81bf-7ed8bb709601', 'volume_name': 'volume-fa25c246-9c03-407c-81bf-7ed8bb709601', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a81b24-ec02-4c80-b01a-cd7c6c328a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18a81b24-ec02-4c80-b01a-cd7c6c328a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ffc6d8-f35a-4c4c-810a-c36bc8881447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume fa25c246-9c03-407c-81bf-7ed8bb709601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa25c246-9c03-407c-81bf-7ed8bb709601', 'volume_size': 1} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (5813c9cc-77ec-4394-afb1-f72f0756dc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97eabf5-5a3d-42c1-ac06-fa8f06ba30a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97eabf5-5a3d-42c1-ac06-fa8f06ba30a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519950845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad82b3a9-5109-4c59-bcfe-47d0c8a555af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:05Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944b8b2d-efb9-498d-8ca3-127d590204d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944b8b2d-efb9-498d-8ca3-127d590204d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419a7729-3d0e-4808-8d8f-5bedb73403eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419a7729-3d0e-4808-8d8f-5bedb73403eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad82b3a9-5109-4c59-bcfe-47d0c8a555af', 'volume_name': 'volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0664b4c3-b63a-4032-8c80-fd3a03563878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0664b4c3-b63a-4032-8c80-fd3a03563878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07f422a-d841-4104-9ecb-cb7387491747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:05 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume ad82b3a9-5109-4c59-bcfe-47d0c8a555af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af', 'volume_size': 1} Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:05 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26 1073741824" returned: 0 in 0.961s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:06 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26 Sep 16 16:22:06 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (e93a1970-bbac-481e-941d-dbd302d858d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc3abe1-4baf-46ee-b16d-69ba27a094d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc3abe1-4baf-46ee-b16d-69ba27a094d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093661537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca3a375-1607-480c-85c4-9178b4f64e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:06Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60c97d8-bba9-466c-834d-ba4fdba51b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60c97d8-bba9-466c-834d-ba4fdba51b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e60f6fd-2859-4272-aa73-7962c60cba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e60f6fd-2859-4272-aa73-7962c60cba66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca3a375-1607-480c-85c4-9178b4f64e0f', 'volume_name': 'volume-eca3a375-1607-480c-85c4-9178b4f64e0f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3421107-51a9-41eb-9b3e-3cc39544f911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3421107-51a9-41eb-9b3e-3cc39544f911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e6186e-09c2-42c8-beb1-d2e7025174e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume eca3a375-1607-480c-85c4-9178b4f64e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca3a375-1607-480c-85c4-9178b4f64e0f', 'volume_size': 1} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:06 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26" returned: 0 in 0.318s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1294035204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e36b17ea-d8a1-4be4-9dac-3606e4eb5cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:04Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Creating volume e36b17ea-d8a1-4be4-9dac-3606e4eb5cde {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:06 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d7612f-083d-44e1-b99b-135bce635ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6563f4-d38f-47f3-a883-0252bed95a26', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:06 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde 1073741824 Sep 16 16:22:06 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874d070c-3b07-46a7-9dea-72daf8d4a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume volume-ee6563f4-d38f-47f3-a883-0252bed95a26 (ee6563f4-d38f-47f3-a883-0252bed95a26): created successfully Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874d070c-3b07-46a7-9dea-72daf8d4a03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (2ff73e4b-84a5-4a7f-ba85-ab8436471c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:06 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-aab01ce3-f316-486a-a9c6-ef7b80e89e0b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created volume successfully. Sep 16 16:22:07 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde 1073741824" returned: 0 in 0.654s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:07 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde Sep 16 16:22:07 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:07 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde" returned: 0 in 0.291s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.027s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303218502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa25c246-9c03-407c-81bf-7ed8bb709601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:05Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Creating volume fa25c246-9c03-407c-81bf-7ed8bb709601 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:07 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a935b36-b97d-4bb0-b264-fa1aa2abe628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:07 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601 1073741824 Sep 16 16:22:07 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05add5b-533c-4893-a09e-aca4e66b721a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:07 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde (e36b17ea-d8a1-4be4-9dac-3606e4eb5cde): created successfully Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05add5b-533c-4893-a09e-aca4e66b721a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (0951f958-f910-43a6-9f54-54fa627656e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-523be9a7-06ca-4913-88ea-ce3839e72d1f tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created volume successfully. Sep 16 16:22:08 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601 1073741824" returned: 0 in 0.620s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:08 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601 Sep 16 16:22:08 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:08 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601" returned: 0 in 0.269s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.656s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519950845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad82b3a9-5109-4c59-bcfe-47d0c8a555af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:05Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Creating volume ad82b3a9-5109-4c59-bcfe-47d0c8a555af {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:08 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ffc6d8-f35a-4c4c-810a-c36bc8881447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa25c246-9c03-407c-81bf-7ed8bb709601', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6981bf4-f2e3-4541-aee1-4dc91f9a78c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:08 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af 1073741824 Sep 16 16:22:08 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:08 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume volume-fa25c246-9c03-407c-81bf-7ed8bb709601 (fa25c246-9c03-407c-81bf-7ed8bb709601): created successfully Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6981bf4-f2e3-4541-aee1-4dc91f9a78c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (4334c647-5fa6-4946-bf84-821a41f522f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:08 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-12f4f7ef-b70e-4c7b-8ef3-c4431a41ac0d tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created volume successfully. Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Flow 'volume_create_manager' (69fc02c5-dea0-4750-8de3-7ba5c04199f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b3e33d-aae2-4269-b156-3b297c8156e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b3e33d-aae2-4269-b156-3b297c8156e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-211435890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71b6aef-c7b8-4919-9680-3df9ea37f7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead948d57b3f41728a6a67c68b00cc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:09Z,use_quota=True,user_id='8076050e5b804962998bfc8d36cea397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118223f2-b1b9-4d79-a50c-f2ca0fed74cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118223f2-b1b9-4d79-a50c-f2ca0fed74cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367cc0dd-a7e3-46c4-bb8c-8a8d3a4944a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367cc0dd-a7e3-46c4-bb8c-8a8d3a4944a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71b6aef-c7b8-4919-9680-3df9ea37f7e5', 'volume_name': 'volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae7e636-7b15-4057-b4a1-c8a0e275477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae7e636-7b15-4057-b4a1-c8a0e275477e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6ac7ce-0c58-4746-92ab-fd52ec81c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Volume b71b6aef-c7b8-4919-9680-3df9ea37f7e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5', 'volume_size': 1} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Flow 'volume_create_manager' (162c371f-1435-4c6a-8a89-9214461b80b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ccd3a9-01b9-4194-a165-ec90aa747370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af 1073741824" returned: 0 in 0.739s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ccd3a9-01b9-4194-a165-ec90aa747370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1085616071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0164f31d-d781-47fa-9577-b576027c2c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c856100958e7494f943e094ee1e0e973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:09Z,use_quota=True,user_id='e94866fda39f46868af493aab7961010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674478c6-d756-4d3a-983c-a4e3907ada27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674478c6-d756-4d3a-983c-a4e3907ada27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe55ae7-d4e7-440a-8006-ddb281c1b88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe55ae7-d4e7-440a-8006-ddb281c1b88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0164f31d-d781-47fa-9577-b576027c2c86', 'volume_name': 'volume-0164f31d-d781-47fa-9577-b576027c2c86', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec68d46-ebcf-42d2-a215-855f44fe8b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec68d46-ebcf-42d2-a215-855f44fe8b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb65c66-c1ad-4046-ab45-85903a7ed7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Volume 0164f31d-d781-47fa-9577-b576027c2c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0164f31d-d781-47fa-9577-b576027c2c86', 'volume_size': 1} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:09 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af Sep 16 16:22:09 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:09 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af" returned: 0 in 0.337s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.295s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07f422a-d841-4104-9ecb-cb7387491747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4463b2c5-35a6-43b2-aa94-adc330fc29da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Creating offline snapshot 5daf3609-555d-4157-b335-afccc209e45e of volume 1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:22:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af (ad82b3a9-5109-4c59-bcfe-47d0c8a555af): created successfully Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4463b2c5-35a6-43b2-aa94-adc330fc29da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (5813c9cc-77ec-4394-afb1-f72f0756dc3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb8229b-8bdd-4a43-8e6e-00f1cf88198f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ad3e767b-3dec-4cab-9e53-596bac45282b tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created volume successfully. Sep 16 16:22:09 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b Sep 16 16:22:09 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:10 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b" returned: 0 in 0.446s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:10 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e 1G Sep 16 16:22:10 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:10 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e 1G" returned: 0 in 0.401s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:10 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e Sep 16 16:22:10 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:10 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e" returned: 0 in 0.284s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:10 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e is being set with open permissions: ugo+rw Sep 16 16:22:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:10 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e Sep 16 16:22:10 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:10 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e" returned: 0 in 0.249s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:11 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.info Sep 16 16:22:11 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:11 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.info" returned: 0 in 0.247s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:11 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.info is being set with open permissions: ugo+rw Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:11 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.info Sep 16 16:22:11 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:11 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.info" returned: 0 in 0.235s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.155s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2093661537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca3a375-1607-480c-85c4-9178b4f64e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c3f19161ce49feb4010eaacc95c636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:06Z,use_quota=True,user_id='11b5fb13dd784a76a0cb67dcd5cf1a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Creating volume eca3a375-1607-480c-85c4-9178b4f64e0f {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:11 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:11 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f 1073741824 Sep 16 16:22:11 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:11 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b0c2e643-40aa-44f5-a34c-b5c0931644fd tempest-VolumesSnapshotTestJSON-785247227 None] Create snapshot completed successfully Sep 16 16:22:11 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f 1073741824" returned: 0 in 0.495s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:12 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f Sep 16 16:22:12 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:12 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f" returned: 0 in 0.282s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.284s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-211435890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71b6aef-c7b8-4919-9680-3df9ea37f7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead948d57b3f41728a6a67c68b00cc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:09Z,use_quota=True,user_id='8076050e5b804962998bfc8d36cea397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Creating volume b71b6aef-c7b8-4919-9680-3df9ea37f7e5 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:12 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:12 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 1073741824 Sep 16 16:22:12 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55e6186e-09c2-42c8-beb1-d2e7025174e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca3a375-1607-480c-85c4-9178b4f64e0f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6570f7d1-69c7-4c82-8a0d-89b3af992b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (78171c5c-a37d-424c-8d30-c057dc2efc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437eef0e-e5a4-48b6-b57a-d59afa59daa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:12 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Volume volume-eca3a375-1607-480c-85c4-9178b4f64e0f (eca3a375-1607-480c-85c4-9178b4f64e0f): created successfully Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6570f7d1-69c7-4c82-8a0d-89b3af992b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Flow 'volume_create_manager' (e93a1970-bbac-481e-941d-dbd302d858d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437eef0e-e5a4-48b6-b57a-d59afa59daa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2040874452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c990b9b-bbfd-4efb-a065-80125e7f85f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eff84b4fc594afc8248ba23bdcc9953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5daf3609-555d-4157-b335-afccc209e45e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:12Z,use_quota=True,user_id='d6283d20a02d448995a3aa0c87249278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfbff98-0669-4bf0-9c33-df08296158f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfbff98-0669-4bf0-9c33-df08296158f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f08406-e2cd-4a4c-bbd1-d308a71b0293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f08406-e2cd-4a4c-bbd1-d308a71b0293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c990b9b-bbfd-4efb-a065-80125e7f85f9', 'volume_name': 'volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9', 'volume_size': 2, 'snapshot_id': '5daf3609-555d-4157-b335-afccc209e45e'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49628c44-324a-4083-8d91-0f18afca9ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49628c44-324a-4083-8d91-0f18afca9ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255c29a8-044d-46ea-ae8d-2e69961ffe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:12 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Volume 9c990b9b-bbfd-4efb-a065-80125e7f85f9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9', 'volume_size': 2, 'snapshot_id': '5daf3609-555d-4157-b335-afccc209e45e'} Sep 16 16:22:12 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ab662e27-4ae9-40e2-bfa0-844d86de49d1 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created volume successfully. Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:12 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 1073741824" returned: 0 in 0.500s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:12 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 Sep 16 16:22:12 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:13 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5" returned: 0 in 0.292s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.041s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1085616071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0164f31d-d781-47fa-9577-b576027c2c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c856100958e7494f943e094ee1e0e973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:09Z,use_quota=True,user_id='e94866fda39f46868af493aab7961010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Creating volume 0164f31d-d781-47fa-9577-b576027c2c86 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:13 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-eca3a375-1607-480c-85c4-9178b4f64e0f-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:13 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86 1073741824 Sep 16 16:22:13 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6ac7ce-0c58-4746-92ab-fd52ec81c08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277183a7-4ca4-48e2-a123-cce14307817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-eca3a375-1607-480c-85c4-9178b4f64e0f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:13 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Volume volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 (b71b6aef-c7b8-4919-9680-3df9ea37f7e5): created successfully Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277183a7-4ca4-48e2-a123-cce14307817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Flow 'volume_create_manager' (69fc02c5-dea0-4750-8de3-7ba5c04199f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:13 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-37055f21-5fd8-474f-8195-675fe1f585e9 tempest-ProjectReaderTests-864006165 None] Created volume successfully. Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-quobyte-eca3a375-1607-480c-85c4-9178b4f64e0f" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-eca3a375-1607-480c-85c4-9178b4f64e0f" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceebddd-e109-4c6b-a3b5-5ec299234167]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:13 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f Sep 16 16:22:13 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:13 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86 1073741824" returned: 0 in 0.505s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:13 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86 Sep 16 16:22:13 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:13 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f" returned: 0 in 0.422s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:13 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f Sep 16 16:22:13 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:14 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.503s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-5daf3609-555d-4157-b335-afccc209e45e-9c990b9b-bbfd-4efb-a065-80125e7f85f9" by "_create_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb65c66-c1ad-4046-ab45-85903a7ed7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0164f31d-d781-47fa-9577-b576027c2c86', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c1c8e0-cf2f-402f-99eb-9499779ec25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-5daf3609-555d-4157-b335-afccc209e45e-9c990b9b-bbfd-4efb-a065-80125e7f85f9" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Creating volume 9c990b9b-bbfd-4efb-a065-80125e7f85f9 from snapshot 5daf3609-555d-4157-b335-afccc209e45e {{(pid=86255) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-9c990b9b-bbfd-4efb-a065-80125e7f85f9" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:14 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Volume volume-0164f31d-d781-47fa-9577-b576027c2c86 (0164f31d-d781-47fa-9577-b576027c2c86): created successfully Sep 16 16:22:14 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c1c8e0-cf2f-402f-99eb-9499779ec25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Flow 'volume_create_manager' (162c371f-1435-4c6a-8a89-9214461b80b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-9c990b9b-bbfd-4efb-a065-80125e7f85f9" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] snapshot: 5daf3609-555d-4157-b335-afccc209e45e, volume: 9c990b9b-bbfd-4efb-a065-80125e7f85f9, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-eca3a375-1607-480c-85c4-9178b4f64e0f" returned: 0 in 0.295s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f8ce7dad-0adb-4987-ab5b-8d5ba3f50d14 tempest-VolumesServicesTestJSON-1455757782 None] Created volume successfully. Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-eca3a375-1607-480c-85c4-9178b4f64e0f" released by "delete_volume" :: held 0.774s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f615f0-f0f5-447e-b59e-1e84bc8a1e2b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created reservations ['a28acdfc-f227-4790-af92-3b3f48725dad', '298fe89f-2495-45ec-acdc-f0d97a37b519', '1ac91874-b5cd-4119-ab9b-89ef7592cd51', '361f1d66-b73d-4665-bc38-6cd66e598a09'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Acquiring lock "cinder-b71b6aef-c7b8-4919-9680-3df9ea37f7e5-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Lock "cinder-b71b6aef-c7b8-4919-9680-3df9ea37f7e5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:14 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e Sep 16 16:22:14 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Acquiring lock "cinder-quobyte-b71b6aef-c7b8-4919-9680-3df9ea37f7e5" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Lock "cinder-quobyte-b71b6aef-c7b8-4919-9680-3df9ea37f7e5" acquired by "delete_volume" :: waited 0.048s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:14 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:14 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b848d3ea-76e4-49bb-9027-ec8c65ce30c1]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-ad82b3a9-5109-4c59-bcfe-47d0c8a555af-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-ad82b3a9-5109-4c59-bcfe-47d0c8a555af-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-quobyte-ad82b3a9-5109-4c59-bcfe-47d0c8a555af" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-ad82b3a9-5109-4c59-bcfe-47d0c8a555af" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a06f26-f382-4ddb-9ebd-3ea390bc7844]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:14 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 Sep 16 16:22:14 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:14 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e" returned: 0 in 0.454s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6045692c-d9a9-481c-95c2-9c0fd03984ba]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:14 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af Sep 16 16:22:14 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:14 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.348s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Deleted volume successfully. Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6158422b-2db7-4927-bb6a-a363c0caa0db tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-eca3a375-1607-480c-85c4-9178b4f64e0f-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:14 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b Sep 16 16:22:14 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:14 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5" returned: 0 in 0.452s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:14 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5 Sep 16 16:22:14 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:14 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af" returned: 0 in 0.404s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:15 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af Sep 16 16:22:15 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:15 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b" returned: 0 in 0.456s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:15 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 Sep 16 16:22:15 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:15 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b71b6aef-c7b8-4919-9680-3df9ea37f7e5" returned: 0 in 0.288s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Lock "cinder-quobyte-b71b6aef-c7b8-4919-9680-3df9ea37f7e5" released by "delete_volume" :: held 0.801s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:15 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ad82b3a9-5109-4c59-bcfe-47d0c8a555af" returned: 0 in 0.304s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-ad82b3a9-5109-4c59-bcfe-47d0c8a555af" released by "delete_volume" :: held 0.750s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Created reservations ['d8515c28-2fd6-4bc3-8d7c-7e537ae2dda7', '55e4e7d2-f24e-4d52-8df6-70ff18e1f088', '4f88802c-d847-40b1-afb2-ecd242be6325', '69fae229-8ef1-4fa6-9f97-42f6e35dd0af'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Acquiring lock "cinder-0164f31d-d781-47fa-9577-b576027c2c86-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Lock "cinder-0164f31d-d781-47fa-9577-b576027c2c86-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Acquiring lock "cinder-quobyte-0164f31d-d781-47fa-9577-b576027c2c86" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Lock "cinder-quobyte-0164f31d-d781-47fa-9577-b576027c2c86" acquired by "delete_volume" :: waited 0.063s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:15 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:15 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created reservations ['53e37332-c8b9-4d9c-ae56-9dbf97deedc6', '3992cf3b-e278-4494-b301-9547a884078b', '778a6731-623c-4c5f-b261-f81b1305165e', 'be1563b1-000a-460c-8bc0-f5dd85cb0378'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38aa769-7b2d-4d4f-91de-8cf80440de04]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:15 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86 Sep 16 16:22:15 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:15 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:15 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:15 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.355s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:15 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Deleted volume successfully. Sep 16 16:22:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-63e27843-da6f-48fd-98cf-809ce4347583 tempest-ProjectReaderTests-864006165 None] Lock "cinder-b71b6aef-c7b8-4919-9680-3df9ea37f7e5-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:16 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.533s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Deleted volume successfully. Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:16 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Flow 'volume_create_manager' (49ba3171-33c7-4e7e-95e7-f9daeda188f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38b493b-02c3-4576-9f65-801bdcf5bb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86" returned: 0 in 0.842s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-10eebe35-dc08-4e44-b80e-dafe36f90e04 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-ad82b3a9-5109-4c59-bcfe-47d0c8a555af-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:16 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86 Sep 16 16:22:16 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38b493b-02c3-4576-9f65-801bdcf5bb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1455632117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51eeb91-af3b-4cf0-85ba-bc5ab572c510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead948d57b3f41728a6a67c68b00cc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:16Z,use_quota=True,user_id='8076050e5b804962998bfc8d36cea397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e41f8ef-ae30-45ae-97f9-1e653d14bd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e41f8ef-ae30-45ae-97f9-1e653d14bd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111b6132-5164-45c0-be07-0970cd6ddd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (111b6132-5164-45c0-be07-0970cd6ddd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51eeb91-af3b-4cf0-85ba-bc5ab572c510', 'volume_name': 'volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ed3071-b480-4979-9589-a3bb2e6f05de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ed3071-b480-4979-9589-a3bb2e6f05de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c78ec3f-a94d-41e3-ad44-164d0495565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:16 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Volume c51eeb91-af3b-4cf0-85ba-bc5ab572c510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510', 'volume_size': 1} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-fa25c246-9c03-407c-81bf-7ed8bb709601-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-fa25c246-9c03-407c-81bf-7ed8bb709601-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:16 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0164f31d-d781-47fa-9577-b576027c2c86" returned: 0 in 0.481s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Lock "cinder-quobyte-0164f31d-d781-47fa-9577-b576027c2c86" released by "delete_volume" :: held 1.418s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-quobyte-fa25c246-9c03-407c-81bf-7ed8bb709601" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-fa25c246-9c03-407c-81bf-7ed8bb709601" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[101a1b04-ac54-43d3-9fad-851b72b706ce]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Created reservations ['dd0c476c-f4a1-4b3c-bfaf-d5add789386a', 'fef4c5f1-62a7-49ab-baa1-6238ae662b6a', 'f021fdfe-166b-4880-81d7-5c4875b5ae46', '14d3dafc-78fa-4557-ba3d-c3a46ba79010'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:17 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601 Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:17 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:17 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:17 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:17 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.499s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:17 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Deleted volume successfully. Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-68c1e77f-3f31-411a-9303-b1f7ce9fdff8 tempest-VolumesServicesTestJSON-1455757782 None] Lock "cinder-0164f31d-d781-47fa-9577-b576027c2c86-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:17 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601" returned: 0 in 0.877s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:18 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601 Sep 16 16:22:18 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:18 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fa25c246-9c03-407c-81bf-7ed8bb709601" returned: 0 in 0.616s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-fa25c246-9c03-407c-81bf-7ed8bb709601" released by "delete_volume" :: held 1.601s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:18 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created reservations ['0fe6cf7f-13fe-47d2-8ce6-d234a1e79489', 'bebdb04b-e0df-45f1-9783-eaacca2f1764', '8a267d91-13b1-40bb-bff0-8ea10a0ea1be', '8e78e0e5-dcf8-4b8f-80bb-fd6da5bd3316'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:18 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:18 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:19 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.419s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:19 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:19 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Deleted volume successfully. Sep 16 16:22:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5601b912-7511-4b88-81c7-17f90e92bb63 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-fa25c246-9c03-407c-81bf-7ed8bb709601-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-quobyte-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde" acquired by "delete_volume" :: waited 0.054s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c66e1ff-9bbf-4c4f-85da-a5b21de968cc]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:19 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde Sep 16 16:22:19 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:20 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde" returned: 0 in 0.867s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:20 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde Sep 16 16:22:20 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:21 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde" returned: 0 in 0.667s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde" released by "delete_volume" :: held 1.655s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created reservations ['37aece86-a10f-42b5-be5c-bfdbc7ae29fe', 'bae0d202-84fd-4b0b-a176-1f5c0b96bcfa', '4724a333-f8cc-49ca-a732-58d0560cd16b', 'aaf62a59-7533-4760-ac9a-7bc617f0b35f'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:21 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:21 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-ee6563f4-d38f-47f3-a883-0252bed95a26-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-ee6563f4-d38f-47f3-a883-0252bed95a26-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-quobyte-ee6563f4-d38f-47f3-a883-0252bed95a26" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-ee6563f4-d38f-47f3-a883-0252bed95a26" acquired by "delete_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:22 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.510s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:22 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Deleted volume successfully. Sep 16 16:22:22 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[20131f2d-9bdf-4e5e-b880-7c3a48f5b740]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7959076d-3d31-45d3-a409-d4d3da34dfd0 tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-e36b17ea-d8a1-4be4-9dac-3606e4eb5cde-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:22 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26 Sep 16 16:22:22 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:22 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26" returned: 0 in 0.839s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:23 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26 Sep 16 16:22:23 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:23 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ee6563f4-d38f-47f3-a883-0252bed95a26" returned: 0 in 0.592s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-ee6563f4-d38f-47f3-a883-0252bed95a26" released by "delete_volume" :: held 1.557s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:23 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created reservations ['148b3cf4-4afd-4e7f-b31a-fa5834cfa943', '37d15e4d-854a-4b2b-b166-da58cf300841', '69fa83f5-a162-4d32-b4d6-bf3576fe151a', '7e74185c-5c97-43f7-afa6-cd00d71f6d96'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:24 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:24 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:24 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9" returned: 0 in 8.938s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:22:24 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Converted 1024.00 MB image at 114.54 MB/s Sep 16 16:22:24 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 is being set with open permissions: ugo+rw Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:24 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 Sep 16 16:22:24 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-f81d3f50-0c32-47f3-adfa-f680883332db-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-f81d3f50-0c32-47f3-adfa-f680883332db-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:24 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.361s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "cinder-quobyte-f81d3f50-0c32-47f3-adfa-f680883332db" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:24 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Deleted volume successfully. Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-f81d3f50-0c32-47f3-adfa-f680883332db" acquired by "delete_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-350c2663-dae6-413c-96d0-ecbb87b694df tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-ee6563f4-d38f-47f3-a883-0252bed95a26-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:24 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9" returned: 0 in 0.321s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0111cb11-a2ee-4a07-b948-a597ffd20452]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-9c990b9b-bbfd-4efb-a065-80125e7f85f9" released by "_copy_volume_from_snapshot" :: held 10.312s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-5daf3609-555d-4157-b335-afccc209e45e-9c990b9b-bbfd-4efb-a065-80125e7f85f9" released by "_create_volume_from_snapshot" :: held 10.423s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.457s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.936s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1455632117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51eeb91-af3b-4cf0-85ba-bc5ab572c510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead948d57b3f41728a6a67c68b00cc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:16Z,use_quota=True,user_id='8076050e5b804962998bfc8d36cea397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Creating volume c51eeb91-af3b-4cf0-85ba-bc5ab572c510 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:24 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:24 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db Sep 16 16:22:24 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:24 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 1073741824 Sep 16 16:22:24 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255c29a8-044d-46ea-ae8d-2e69961ffe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9', 'volume_size': 2, 'snapshot_id': '5daf3609-555d-4157-b335-afccc209e45e'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6af2061-3fac-4c92-8c4e-06c4a7c3a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:24 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Volume volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 (9c990b9b-bbfd-4efb-a065-80125e7f85f9): created successfully Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6af2061-3fac-4c92-8c4e-06c4a7c3a37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (78171c5c-a37d-424c-8d30-c057dc2efc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:24 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0a9ca249-ff3c-4734-883f-496db1ce68b4 tempest-VolumesSnapshotTestJSON-785247227 None] Created volume successfully. Sep 16 16:22:24 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:24 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db Sep 16 16:22:24 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:25 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 1073741824" returned: 0 in 0.593s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:25 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f81d3f50-0c32-47f3-adfa-f680883332db" returned: 0 in 0.304s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:25 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 Sep 16 16:22:25 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-quobyte-f81d3f50-0c32-47f3-adfa-f680883332db" released by "delete_volume" :: held 0.825s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Created reservations ['6bd38ebc-8df4-49eb-9c76-04ceb7f15b35', '285767b0-6d46-47ef-bd79-26f4d0295d6c', '63256bc2-ade1-4d02-89df-70feef8a2fa6', 'd210b648-3432-4dc9-978b-9afa10b11301'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:25 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:25 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:25 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510" returned: 0 in 0.300s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c78ec3f-a94d-41e3-ad44-164d0495565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd68e5e-1a5c-4d9f-8733-84558799c1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:25 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Volume volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 (c51eeb91-af3b-4cf0-85ba-bc5ab572c510): created successfully Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd68e5e-1a5c-4d9f-8733-84558799c1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Flow 'volume_create_manager' (49ba3171-33c7-4e7e-95e7-f9daeda188f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:25 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e1a539b1-b4b3-48d2-a318-cc680438d2c1 tempest-ProjectReaderTests-864006165 None] Created volume successfully. Sep 16 16:22:25 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.295s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:25 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Deleted volume successfully. Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8b5a8d0e-e33f-4c3d-99e3-e2aad5c9067c tempest-CreateVolumesFromSourceVolumeTest-1814705842 None] Lock "cinder-f81d3f50-0c32-47f3-adfa-f680883332db-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-9c990b9b-bbfd-4efb-a065-80125e7f85f9-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-9c990b9b-bbfd-4efb-a065-80125e7f85f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-9c990b9b-bbfd-4efb-a065-80125e7f85f9" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-9c990b9b-bbfd-4efb-a065-80125e7f85f9" acquired by "delete_volume" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[12776956-d62b-4fb3-a8ab-e063629e99fa]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:26 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 Sep 16 16:22:26 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Acquiring lock "cinder-c51eeb91-af3b-4cf0-85ba-bc5ab572c510-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Lock "cinder-c51eeb91-af3b-4cf0-85ba-bc5ab572c510-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Acquiring lock "cinder-quobyte-c51eeb91-af3b-4cf0-85ba-bc5ab572c510" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Lock "cinder-quobyte-c51eeb91-af3b-4cf0-85ba-bc5ab572c510" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:26 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9" returned: 0 in 0.527s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfacc9c-506f-4dce-a6f9-7ae8c4805e6c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:26 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9 Sep 16 16:22:26 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:26 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 Sep 16 16:22:26 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:26 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9c990b9b-bbfd-4efb-a065-80125e7f85f9" returned: 0 in 0.379s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-9c990b9b-bbfd-4efb-a065-80125e7f85f9" released by "delete_volume" :: held 0.971s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:26 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Created reservations ['04dc62e5-5e49-4386-b614-02a84e554471', 'ef2f5ec7-f514-4ed4-b3db-937f17442935', 'e903c983-b28f-4b9d-b2d9-5ecd3f5d97ce', '0b2a5c4a-0af9-4dd2-b354-05170087ffd6'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:27 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510" returned: 0 in 0.579s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:27 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:27 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:27 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510 Sep 16 16:22:27 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:27 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.294s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:27 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Deleted volume successfully. Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4898eeaf-6887-49e9-9af4-2c918df9850d tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-9c990b9b-bbfd-4efb-a065-80125e7f85f9-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:27 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c51eeb91-af3b-4cf0-85ba-bc5ab572c510" returned: 0 in 0.363s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Lock "cinder-quobyte-c51eeb91-af3b-4cf0-85ba-bc5ab572c510" released by "delete_volume" :: held 1.020s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Created reservations ['523cf5d3-fb1c-436c-9212-7f642b8dd80b', '9b463f76-03cb-4ec8-96e0-948aa2605e4e', '77b9228b-8eea-4c34-b681-af130735f940', '1f1597f5-d7cd-4760-9521-480cfb7751bf'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:27 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:27 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:27 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.295s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:27 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:27 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Deleted volume successfully. Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-485d59d2-8d6f-4517-b7f9-10ead22e1a85 tempest-ProjectReaderTests-864006165 None] Lock "cinder-c51eeb91-af3b-4cf0-85ba-bc5ab572c510-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-5daf3609-555d-4157-b335-afccc209e45e-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-5daf3609-555d-4157-b335-afccc209e45e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-1f981965-12b8-4e68-ad30-2d6d7b287c7b" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-1f981965-12b8-4e68-ad30-2d6d7b287c7b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-5daf3609-555d-4157-b335-afccc209e45e" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-5daf3609-555d-4157-b335-afccc209e45e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Deleting offline snapshot 5daf3609-555d-4157-b335-afccc209e45e of volume 1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] snapshot_file for this snap is: volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffb2826-2d7f-409d-b8a0-b635c568b53a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:28 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e Sep 16 16:22:28 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Flow 'volume_create_manager' (7af5a1f2-c5f9-4337-a00f-472008c9ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e421709-74d7-4769-bbd5-58a012e481a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e421709-74d7-4769-bbd5-58a012e481a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-253445401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1626eb-e251-4660-8b03-eec0456bf73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3dc018702af4edb9d58ee44edc63fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:28Z,use_quota=True,user_id='3cac206106a74a1ea6f01124fa1e3d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4484798c-975d-4bed-8546-0a550188a5cf),volume_type_id=4484798c-975d-4bed-8546-0a550188a5cf)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e250806-54e6-45bc-992c-a0e5573f6f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e250806-54e6-45bc-992c-a0e5573f6f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa0a596-7112-489d-bc00-d20412a062a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baa0a596-7112-489d-bc00-d20412a062a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1626eb-e251-4660-8b03-eec0456bf73e', 'volume_name': 'volume-2a1626eb-e251-4660-8b03-eec0456bf73e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87158a07-4087-4099-999c-b2fc934bed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87158a07-4087-4099-999c-b2fc934bed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec886b3-14a6-460b-b540-8d4ecdad8953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:28 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Volume 2a1626eb-e251-4660-8b03-eec0456bf73e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1626eb-e251-4660-8b03-eec0456bf73e', 'volume_size': 1} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-253445401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1626eb-e251-4660-8b03-eec0456bf73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3dc018702af4edb9d58ee44edc63fea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:28Z,use_quota=True,user_id='3cac206106a74a1ea6f01124fa1e3d3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4484798c-975d-4bed-8546-0a550188a5cf),volume_type_id=4484798c-975d-4bed-8546-0a550188a5cf)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Creating volume 2a1626eb-e251-4660-8b03-eec0456bf73e {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:28 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:28 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e 1073741824 Sep 16 16:22:28 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:28 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e" returned: 0 in 0.504s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[649ac79b-4965-4e0c-aec0-61470765c2f4]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:29 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b Sep 16 16:22:29 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:29 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e 1073741824" returned: 0 in 0.590s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:29 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e Sep 16 16:22:29 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:29 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e" returned: 0 in 0.333s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:29 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b" returned: 0 in 0.748s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec886b3-14a6-460b-b540-8d4ecdad8953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1626eb-e251-4660-8b03-eec0456bf73e', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:29 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e Sep 16 16:22:29 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445f4a02-d756-4965-b5ea-91ae3925232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:29 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Volume volume-2a1626eb-e251-4660-8b03-eec0456bf73e (2a1626eb-e251-4660-8b03-eec0456bf73e): created successfully Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (445f4a02-d756-4965-b5ea-91ae3925232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Flow 'volume_create_manager' (7af5a1f2-c5f9-4337-a00f-472008c9ed89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7a9ba3f5-61f5-421d-a3ea-080f01d7a610 tempest-VolumeTypesAccessTest-272946067 None] Created volume successfully. Sep 16 16:22:29 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Flow 'volume_create_manager' (626cee6c-e180-4ec2-98df-11d5f41f8863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4436a223-edbd-4e9b-9ef1-e540ac2cc6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4436a223-edbd-4e9b-9ef1-e540ac2cc6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e48c94c-5110-4fa0-86bc-64721f1d1e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ede141fd204fecb4fa39a0b35080e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:30Z,use_quota=True,user_id='024016c91a3c439692e2b3980cef6cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e7bf76-238f-467a-9706-fa3df54c135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e7bf76-238f-467a-9706-fa3df54c135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb73b6b-ce9b-48d6-b1b7-11dbb3514b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb73b6b-ce9b-48d6-b1b7-11dbb3514b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e48c94c-5110-4fa0-86bc-64721f1d1e68', 'volume_name': 'volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b9b438-368a-45b3-bfa4-d0006274d674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42b9b438-368a-45b3-bfa4-d0006274d674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cae8ad-85f3-48fb-bf13-3d55f93354e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:30 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Volume 4e48c94c-5110-4fa0-86bc-64721f1d1e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68', 'volume_size': 1} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e48c94c-5110-4fa0-86bc-64721f1d1e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ede141fd204fecb4fa39a0b35080e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:30Z,use_quota=True,user_id='024016c91a3c439692e2b3980cef6cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Creating volume 4e48c94c-5110-4fa0-86bc-64721f1d1e68 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:30 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:30 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e" returned: 0 in 0.458s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:30 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 1073741824 Sep 16 16:22:30 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:30 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e Sep 16 16:22:30 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:30 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b.5daf3609-555d-4157-b335-afccc209e45e" returned: 0 in 0.287s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-5daf3609-555d-4157-b335-afccc209e45e" released by "_delete_snapshot" :: held 2.201s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-1f981965-12b8-4e68-ad30-2d6d7b287c7b" released by "delete_snapshot" :: held 2.230s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Created reservations ['043a770c-c5d2-45dd-987e-5dbacf847f6c', '2371f602-2ddb-4fea-ac19-30d60b00fbfc', 'ce01d726-c21c-4b53-9f89-94980d56c0f6', 'e319cf5c-22d9-47d5-b570-849be5a62260'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:30 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Delete snapshot completed successfully. Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-26be51e0-7471-4f50-aa5f-d28046e32c8a tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-5daf3609-555d-4157-b335-afccc209e45e-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:30 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Acquiring lock "cinder-2a1626eb-e251-4660-8b03-eec0456bf73e-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 1073741824" returned: 0 in 0.646s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Lock "cinder-2a1626eb-e251-4660-8b03-eec0456bf73e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Acquiring lock "cinder-quobyte-2a1626eb-e251-4660-8b03-eec0456bf73e" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:30 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 Sep 16 16:22:30 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Lock "cinder-quobyte-2a1626eb-e251-4660-8b03-eec0456bf73e" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d1dde3-fdaa-454a-bad6-f3f308bf7323]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:31 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e Sep 16 16:22:31 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:31 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68" returned: 0 in 0.284s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58cae8ad-85f3-48fb-bf13-3d55f93354e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34330c3-5a82-4946-9f96-931744948c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:31 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Volume volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 (4e48c94c-5110-4fa0-86bc-64721f1d1e68): created successfully Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34330c3-5a82-4946-9f96-931744948c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Flow 'volume_create_manager' (626cee6c-e180-4ec2-98df-11d5f41f8863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a024da2f-5372-43ec-a36f-64f06283256d tempest-CinderUnicodeTest-28033380 None] Created volume successfully. Sep 16 16:22:31 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e" returned: 0 in 0.404s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:31 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e Sep 16 16:22:31 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-1f981965-12b8-4e68-ad30-2d6d7b287c7b-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-1f981965-12b8-4e68-ad30-2d6d7b287c7b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:31 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2a1626eb-e251-4660-8b03-eec0456bf73e" returned: 0 in 0.292s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Lock "cinder-quobyte-2a1626eb-e251-4660-8b03-eec0456bf73e" released by "delete_volume" :: held 0.756s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-1f981965-12b8-4e68-ad30-2d6d7b287c7b" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-1f981965-12b8-4e68-ad30-2d6d7b287c7b" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0301af-ab20-46ea-9fc9-f13d4586cc44]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:31 devstack cinder-volume[86255]: WARNING cinder.quota [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1880121851 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1880121851, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:22:31 devstack cinder-volume[86255]: WARNING cinder.quota [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1880121851 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1880121851, it is now deprecated. Please use the default quota class for default quota. Sep 16 16:22:31 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b Sep 16 16:22:31 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Created reservations ['fdca68ed-2842-4d98-8b08-4622756d350c', '93fadd5b-b914-45e4-b742-2cad9a6df582', '8e799139-a740-49b8-b1a3-4a8030c0557a', '3a0b938d-0018-49d9-9ae8-d182e67958a2'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:32 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b" returned: 0 in 0.436s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:32 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:32 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:32 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b Sep 16 16:22:32 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:32 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.312s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Deleted volume successfully. Sep 16 16:22:32 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-1f981965-12b8-4e68-ad30-2d6d7b287c7b" returned: 0 in 0.333s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d49ea40c-6af0-4c0a-9bee-7112873a5472 tempest-VolumeTypesAccessTest-272946067 None] Lock "cinder-2a1626eb-e251-4660-8b03-eec0456bf73e-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-1f981965-12b8-4e68-ad30-2d6d7b287c7b" released by "delete_volume" :: held 0.851s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=230,cinder:SELECT=183,cinder:INSERT=68,cinder:DELETE=16 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=181,cinder:INSERT=55,cinder:UPDATE=230,cinder:DELETE=22 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Created reservations ['94aaaead-a515-4821-b3f8-2b8121814b57', 'a4cef4c0-46e8-4d41-9ca8-68acb207bfe1', '4eb72fe2-c088-46c3-8712-34d74db7ec39', 'cc640263-f46a-4da3-9510-66f66755b3e3'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:32 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:32 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Flow 'volume_create_manager' (f3ca4952-e9c4-4a43-a7fb-982a7e867069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0221de-efd1-4a8b-ad3a-8888d1794d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0221de-efd1-4a8b-ad3a-8888d1794d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-665024844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2332a648-1dc5-4f84-a30d-7b5ef41a1a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ede141fd204fecb4fa39a0b35080e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:33Z,use_quota=True,user_id='024016c91a3c439692e2b3980cef6cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d621e404-9e50-474e-b5f6-4c731c7bee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d621e404-9e50-474e-b5f6-4c731c7bee63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee08936-e9e7-4716-ac8b-d8f86efa8ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee08936-e9e7-4716-ac8b-d8f86efa8ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2332a648-1dc5-4f84-a30d-7b5ef41a1a88', 'volume_name': 'volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afaff33d-7280-4bca-95fc-7b8f9f3e24f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afaff33d-7280-4bca-95fc-7b8f9f3e24f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ef615b-8674-4663-a8fa-971a40e05b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Volume 2332a648-1dc5-4f84-a30d-7b5ef41a1a88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88', 'volume_size': 1} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-665024844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2332a648-1dc5-4f84-a30d-7b5ef41a1a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9ede141fd204fecb4fa39a0b35080e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:33Z,use_quota=True,user_id='024016c91a3c439692e2b3980cef6cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Creating volume 2332a648-1dc5-4f84-a30d-7b5ef41a1a88 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:33 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:33 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.310s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:33 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 1073741824 Sep 16 16:22:33 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Deleted volume successfully. Sep 16 16:22:33 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-59b4b3a8-fbf1-4319-ab9a-f5019facd8a5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-1f981965-12b8-4e68-ad30-2d6d7b287c7b-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (998013ba-49a1-4958-981a-6f4c1d9b31bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e001f5f8-b9dd-4579-8280-f3d106f293e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e001f5f8-b9dd-4579-8280-f3d106f293e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1339228627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421a87cd-42da-4c75-9a99-4336a80377df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eff84b4fc594afc8248ba23bdcc9953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:33Z,use_quota=True,user_id='d6283d20a02d448995a3aa0c87249278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b3e189-15b4-465e-bee1-9e073db81031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b3e189-15b4-465e-bee1-9e073db81031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5657d9c2-57e4-4d43-b137-f8a94a10f297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5657d9c2-57e4-4d43-b137-f8a94a10f297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '421a87cd-42da-4c75-9a99-4336a80377df', 'volume_name': 'volume-421a87cd-42da-4c75-9a99-4336a80377df', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:33 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b64af2-1892-436d-b405-fac2fbf4c7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b64af2-1892-436d-b405-fac2fbf4c7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cf7315-7d78-4feb-a2b1-3357fa3bca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Volume 421a87cd-42da-4c75-9a99-4336a80377df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-421a87cd-42da-4c75-9a99-4336a80377df', 'volume_size': 1} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 1073741824" returned: 0 in 0.587s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:33 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 Sep 16 16:22:33 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:33 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" returned: 0 in 0.293s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.336s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1339228627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421a87cd-42da-4c75-9a99-4336a80377df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eff84b4fc594afc8248ba23bdcc9953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:33Z,use_quota=True,user_id='d6283d20a02d448995a3aa0c87249278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Creating volume 421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:33 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:22:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ef615b-8674-4663-a8fa-971a40e05b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1694941-df1f-4422-abf2-1350427f4190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:34 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df 1073741824 Sep 16 16:22:34 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Volume volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 (2332a648-1dc5-4f84-a30d-7b5ef41a1a88): created successfully Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1694941-df1f-4422-abf2-1350427f4190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Flow 'volume_create_manager' (f3ca4952-e9c4-4a43-a7fb-982a7e867069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:34 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-95db2f14-2e17-4ea1-b66c-be7ccd2cdef7 tempest-CinderUnicodeTest-28033380 None] Created volume successfully. Sep 16 16:22:34 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df 1073741824" returned: 0 in 0.615s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:34 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df Sep 16 16:22:34 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:34 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df" returned: 0 in 0.331s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68cf7315-7d78-4feb-a2b1-3357fa3bca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421a87cd-42da-4c75-9a99-4336a80377df', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa66152-9c3e-4a51-b63d-cd388b537274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Volume volume-421a87cd-42da-4c75-9a99-4336a80377df (421a87cd-42da-4c75-9a99-4336a80377df): created successfully Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa66152-9c3e-4a51-b63d-cd388b537274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (998013ba-49a1-4958-981a-6f4c1d9b31bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-fc7b05c2-c7c4-4a2e-9209-eea8e57a35b3 tempest-VolumesSnapshotTestJSON-785247227 None] Created volume successfully. Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Creating offline snapshot 39e98de5-eb74-4bf6-b564-724c5c5ccf71 of volume 2332a648-1dc5-4f84-a30d-7b5ef41a1a88 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b65ae90-c6b1-4e9c-8ddc-cd2911b597fa]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:35 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 Sep 16 16:22:35 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:35 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" returned: 0 in 0.486s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:35 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 1G Sep 16 16:22:35 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:36 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 1G" returned: 0 in 0.633s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:36 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 Sep 16 16:22:36 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:36 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71" returned: 0 in 0.352s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:36 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 is being set with open permissions: ugo+rw Sep 16 16:22:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:36 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 Sep 16 16:22:36 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:37 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71" returned: 0 in 0.330s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:37 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.info Sep 16 16:22:37 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:37 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.info" returned: 0 in 0.301s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:37 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.info is being set with open permissions: ugo+rw Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:37 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.info Sep 16 16:22:37 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:37 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.info" returned: 0 in 0.322s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.563s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.828s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Creating offline snapshot 3560e33a-c625-4863-8fee-dbe14ffdddaa of volume 421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:22:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-bef44d4b-75f6-4119-b43d-b5d099f13b74 tempest-CinderUnicodeTest-28033380 None] Create snapshot completed successfully Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e46b0e7-aa74-43d7-ac72-b5e562eeb25c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:38 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df Sep 16 16:22:38 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:38 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df" returned: 0 in 0.441s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:38 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa 1G Sep 16 16:22:38 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Acquiring lock "cinder-39e98de5-eb74-4bf6-b564-724c5c5ccf71-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-39e98de5-eb74-4bf6-b564-724c5c5ccf71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Acquiring lock "cinder-quobyte-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-quobyte-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Acquiring lock "cinder-quobyte-39e98de5-eb74-4bf6-b564-724c5c5ccf71" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-quobyte-39e98de5-eb74-4bf6-b564-724c5c5ccf71" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Deleting offline snapshot 39e98de5-eb74-4bf6-b564-724c5c5ccf71 of volume 2332a648-1dc5-4f84-a30d-7b5ef41a1a88 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] snapshot_file for this snap is: volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d814397a-b42b-46c5-a505-03528e6a12ed]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:38 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 Sep 16 16:22:38 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:38 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa 1G" returned: 0 in 0.531s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421a87cd-42da-4c75-9a99-4336a80377df -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:38 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421a87cd-42da-4c75-9a99-4336a80377df -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa Sep 16 16:22:38 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:39 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71" returned: 0 in 0.445s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bec545-d1e1-4df6-9426-fb0a69f281bd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:39 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-421a87cd-42da-4c75-9a99-4336a80377df -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa" returned: 0 in 0.354s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:39 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa is being set with open permissions: ugo+rw Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:39 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa Sep 16 16:22:39 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:39 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 Sep 16 16:22:39 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:39 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa" returned: 0 in 0.285s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:39 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:39 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.info Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" returned: 0 in 0.430s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:39 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:39 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 Sep 16 16:22:39 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:39 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.info" returned: 0 in 0.277s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:39 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.info is being set with open permissions: ugo+rw Sep 16 16:22:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:39 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.info Sep 16 16:22:39 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:40 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71" returned: 0 in 0.431s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:40 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71 Sep 16 16:22:40 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:40 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.info" returned: 0 in 0.257s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-56ab7840-0ddf-46bf-995a-cfc15cd045a2 tempest-VolumesSnapshotTestJSON-785247227 None] Create snapshot completed successfully Sep 16 16:22:40 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88.39e98de5-eb74-4bf6-b564-724c5c5ccf71" returned: 0 in 0.268s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-quobyte-39e98de5-eb74-4bf6-b564-724c5c5ccf71" released by "_delete_snapshot" :: held 1.707s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-quobyte-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" released by "delete_snapshot" :: held 1.734s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Created reservations ['23a88110-b4a5-4aac-a3dc-319855db3537', '8d3608a7-891e-41f6-a597-88ce1ea792be', '9d0eae4f-2ebc-418b-8b45-9ed996db324f', '354e0575-15d6-4b44-8c3f-36a3f98e7dcd'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Delete snapshot completed successfully. Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de1c43d0-6e64-49b4-a5a7-6ee13b0d7962 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-39e98de5-eb74-4bf6-b564-724c5c5ccf71-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Acquiring lock "cinder-2332a648-1dc5-4f84-a30d-7b5ef41a1a88-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Lock "cinder-2332a648-1dc5-4f84-a30d-7b5ef41a1a88-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Acquiring lock "cinder-quobyte-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Lock "cinder-quobyte-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6f46e3-ccc7-48e6-817c-66aa213b32b5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:40 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 Sep 16 16:22:40 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:41 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" returned: 0 in 0.412s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:41 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88 Sep 16 16:22:41 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:41 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" returned: 0 in 0.343s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Lock "cinder-quobyte-2332a648-1dc5-4f84-a30d-7b5ef41a1a88" released by "delete_volume" :: held 0.850s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Created reservations ['92aa9708-cc9f-4404-a6a8-292457b3e764', '0fc82e7e-827b-4dca-afd9-825afea5fc32', '33f60250-c86d-4b2b-8f27-bde611da0d94', '0c5e61f0-3c52-4b03-9b30-29105c480692'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:41 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:41 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Acquiring lock "cinder-4e48c94c-5110-4fa0-86bc-64721f1d1e68-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:41 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:42 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-4e48c94c-5110-4fa0-86bc-64721f1d1e68-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (e824495f-f636-4e45-87c5-cd23a64a5ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b10c89-1d41-44f4-8042-549120fb3481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b10c89-1d41-44f4-8042-549120fb3481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-852780506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355f2517-1938-4810-8c85-74b6a0c10873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eff84b4fc594afc8248ba23bdcc9953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3560e33a-c625-4863-8fee-dbe14ffdddaa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:22:42Z,use_quota=True,user_id='d6283d20a02d448995a3aa0c87249278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab9ed15-bbd2-4f24-bdd4-d503cae0876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab9ed15-bbd2-4f24-bdd4-d503cae0876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65838148-b2b1-448d-99f3-76fd665330d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65838148-b2b1-448d-99f3-76fd665330d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '355f2517-1938-4810-8c85-74b6a0c10873', 'volume_name': 'volume-355f2517-1938-4810-8c85-74b6a0c10873', 'volume_size': 1, 'snapshot_id': '3560e33a-c625-4863-8fee-dbe14ffdddaa'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b419f336-a543-4f67-9527-68475624c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b419f336-a543-4f67-9527-68475624c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3a013d-61b9-4055-a7d6-a15637172616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:42 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Volume 355f2517-1938-4810-8c85-74b6a0c10873: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-355f2517-1938-4810-8c85-74b6a0c10873', 'volume_size': 1, 'snapshot_id': '3560e33a-c625-4863-8fee-dbe14ffdddaa'} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-3560e33a-c625-4863-8fee-dbe14ffdddaa-355f2517-1938-4810-8c85-74b6a0c10873" by "_create_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:42 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Acquiring lock "cinder-quobyte-4e48c94c-5110-4fa0-86bc-64721f1d1e68" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.411s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-3560e33a-c625-4863-8fee-dbe14ffdddaa-355f2517-1938-4810-8c85-74b6a0c10873" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Creating volume 355f2517-1938-4810-8c85-74b6a0c10873 from snapshot 3560e33a-c625-4863-8fee-dbe14ffdddaa {{(pid=86255) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-355f2517-1938-4810-8c85-74b6a0c10873" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-quobyte-4e48c94c-5110-4fa0-86bc-64721f1d1e68" acquired by "delete_volume" :: waited 0.059s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-355f2517-1938-4810-8c85-74b6a0c10873" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] snapshot: 3560e33a-c625-4863-8fee-dbe14ffdddaa, volume: 355f2517-1938-4810-8c85-74b6a0c10873, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cda412-c906-4496-9d6d-a73fc591e175]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c85fb3-248a-4c19-8a27-45eb1d6b283d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:42 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.376s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Deleted volume successfully. Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-da206a58-5619-4d67-a4a0-15dd46763cdd tempest-CinderUnicodeTest-28033380 None] Lock "cinder-2332a648-1dc5-4f84-a30d-7b5ef41a1a88-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:42 devstack sudo[101295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 Sep 16 16:22:42 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:42 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa Sep 16 16:22:42 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:42 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68" returned: 0 in 0.445s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:42 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa" returned: 0 in 0.441s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-421a87cd-42da-4c75-9a99-4336a80377df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:22:42 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68 Sep 16 16:22:42 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b3ffc-ad45-4bc5-9669-82530420c3f7]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:42 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df Sep 16 16:22:42 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:43 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e48c94c-5110-4fa0-86bc-64721f1d1e68" returned: 0 in 0.317s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-quobyte-4e48c94c-5110-4fa0-86bc-64721f1d1e68" released by "delete_volume" :: held 0.857s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Created reservations ['53cd5639-9e5c-4933-be5f-30444154c50b', 'c4c21eeb-688d-4d41-8935-0a4699b3c4a0', '94273519-3fb1-4f35-a442-c01313012504', '40c12dce-50f1-4c9e-87ba-a60514b7f8a8'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:43 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df" returned: 0 in 0.449s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:43 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 Sep 16 16:22:43 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:43 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:43 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:43 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.288s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Deleted volume successfully. Sep 16 16:22:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c71f6b78-4c0f-4278-b3f9-6bd71c5c3877 tempest-CinderUnicodeTest-28033380 None] Lock "cinder-4e48c94c-5110-4fa0-86bc-64721f1d1e68-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:51 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873" returned: 0 in 7.896s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df, size 1024.00 MB, duration 7.90 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:22:51 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Converted 1024.00 MB image at 129.66 MB/s Sep 16 16:22:51 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 is being set with open permissions: ugo+rw Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:51 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 Sep 16 16:22:51 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:51 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873" returned: 0 in 0.307s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-355f2517-1938-4810-8c85-74b6a0c10873" released by "_copy_volume_from_snapshot" :: held 9.208s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-3560e33a-c625-4863-8fee-dbe14ffdddaa-355f2517-1938-4810-8c85-74b6a0c10873" released by "_create_volume_from_snapshot" :: held 9.313s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.351s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f3a013d-61b9-4055-a7d6-a15637172616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355f2517-1938-4810-8c85-74b6a0c10873', 'volume_size': 1, 'snapshot_id': '3560e33a-c625-4863-8fee-dbe14ffdddaa'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e568778-4974-491f-b20b-0561886b1b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:22:51 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Volume volume-355f2517-1938-4810-8c85-74b6a0c10873 (355f2517-1938-4810-8c85-74b6a0c10873): created successfully Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e568778-4974-491f-b20b-0561886b1b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:22:51 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Flow 'volume_create_manager' (e824495f-f636-4e45-87c5-cd23a64a5ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:22:51 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6c1211c9-9ed6-490a-9e24-453e0460631c tempest-VolumesSnapshotTestJSON-785247227 None] Created volume successfully. Sep 16 16:22:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-355f2517-1938-4810-8c85-74b6a0c10873-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-355f2517-1938-4810-8c85-74b6a0c10873-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-355f2517-1938-4810-8c85-74b6a0c10873" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-355f2517-1938-4810-8c85-74b6a0c10873" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:52 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[54aaaf39-3fd7-4b0e-8a79-a2fc2ead4711]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:52 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 Sep 16 16:22:52 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:52 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873" returned: 0 in 0.436s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:52 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873 Sep 16 16:22:52 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:53 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-355f2517-1938-4810-8c85-74b6a0c10873" returned: 0 in 0.266s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-355f2517-1938-4810-8c85-74b6a0c10873" released by "delete_volume" :: held 0.760s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Created reservations ['a7771745-e72a-4ab3-9068-b95277be7bfb', '2f7e07ff-dce9-45f7-a96e-879840ad3c85', '77bdcfe2-7526-4f10-aaab-59066d4dfa34', 'c42724d8-6c4e-4407-8f72-9784f4fdcb41'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:53 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:53 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-3560e33a-c625-4863-8fee-dbe14ffdddaa-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-3560e33a-c625-4863-8fee-dbe14ffdddaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-421a87cd-42da-4c75-9a99-4336a80377df" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:53 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.359s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-421a87cd-42da-4c75-9a99-4336a80377df" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-3560e33a-c625-4863-8fee-dbe14ffdddaa" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:53 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Deleted volume successfully. Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-3560e33a-c625-4863-8fee-dbe14ffdddaa" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Deleting offline snapshot 3560e33a-c625-4863-8fee-dbe14ffdddaa of volume 421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] snapshot_file for this snap is: volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-819477a6-1756-4be0-af71-acbbf90444c5 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-355f2517-1938-4810-8c85-74b6a0c10873-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f35f28-3be8-47d1-8340-2717182f8d91]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:53 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa Sep 16 16:22:53 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:54 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa" returned: 0 in 0.424s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-421a87cd-42da-4c75-9a99-4336a80377df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:22:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03de060-d756-49f0-8fdc-d68de1b3861a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:54 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df Sep 16 16:22:54 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:54 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df" returned: 0 in 0.805s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:54 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa Sep 16 16:22:54 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:55 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa" returned: 0 in 0.379s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:55 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa Sep 16 16:22:55 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:55 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df.3560e33a-c625-4863-8fee-dbe14ffdddaa" returned: 0 in 0.270s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-3560e33a-c625-4863-8fee-dbe14ffdddaa" released by "_delete_snapshot" :: held 2.044s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-421a87cd-42da-4c75-9a99-4336a80377df" released by "delete_snapshot" :: held 2.098s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:55 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Created reservations ['53abb425-d57c-43c0-bad3-28e334e572dc', '5337f626-96ed-495f-ade2-7c4f12d7e20e', '8ca00c16-c41e-407a-96ff-9f5d24ed7e9a', '7c40e926-70e2-4fba-a69d-c9de1ea53332'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:55 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Delete snapshot completed successfully. Sep 16 16:22:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c693399-b0bf-46cf-9c45-524a43bf95cd tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-3560e33a-c625-4863-8fee-dbe14ffdddaa-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-421a87cd-42da-4c75-9a99-4336a80377df-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-421a87cd-42da-4c75-9a99-4336a80377df-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-421a87cd-42da-4c75-9a99-4336a80377df" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-421a87cd-42da-4c75-9a99-4336a80377df" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:57 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e5d39e-8bcb-4e71-9891-6d6730e43487]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:57 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df Sep 16 16:22:57 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:57 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df" returned: 0 in 0.473s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:57 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df Sep 16 16:22:57 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:57 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-421a87cd-42da-4c75-9a99-4336a80377df" returned: 0 in 0.356s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-421a87cd-42da-4c75-9a99-4336a80377df" released by "delete_volume" :: held 0.943s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Created reservations ['471514ba-b790-4d9f-ac84-949f5762a07e', '9f08cc90-8fb2-4764-92b7-eaf11684a6c6', '6dfcdc82-591d-4f45-b9cf-269b07dfc5a9', '866cd729-556d-49a0-8ece-b512241cc5c9'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:58 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:22:58 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:22:58 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.294s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:22:58 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Deleted volume successfully. Sep 16 16:22:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0b84f589-6b97-4a43-a698-073d9ff11d4e tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-421a87cd-42da-4c75-9a99-4336a80377df-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:22:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-5885f277-4aad-4e0f-a068-0efc7760c7fb-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-5885f277-4aad-4e0f-a068-0efc7760c7fb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "cinder-quobyte-5885f277-4aad-4e0f-a068-0efc7760c7fb" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:22:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-5885f277-4aad-4e0f-a068-0efc7760c7fb" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:22:59 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0ba24d-6b19-4018-951b-b2a8d798d610]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:22:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:22:59 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb Sep 16 16:22:59 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:00 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb" returned: 0 in 0.494s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:00 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb Sep 16 16:23:00 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:00 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5885f277-4aad-4e0f-a068-0efc7760c7fb" returned: 0 in 0.381s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-quobyte-5885f277-4aad-4e0f-a068-0efc7760c7fb" released by "delete_volume" :: held 0.982s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Created reservations ['4047c1da-ec39-4308-a59b-3767095103ae', 'b0310754-e47a-4d61-aa2e-5a0f4c3261f1', 'dfa86779-8d62-4908-89c8-6e1ad0e0cc9f', 'af7274c9-cdb6-459d-9885-3f115dce6dfd'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:00 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:00 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:00 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.312s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:00 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Deleted volume successfully. Sep 16 16:23:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7c2e459d-5205-4212-96b0-91cfded2a7d4 tempest-VolumesSnapshotTestJSON-785247227 None] Lock "cinder-5885f277-4aad-4e0f-a068-0efc7760c7fb-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Flow 'volume_create_manager' (50bdb558-7d34-4a00-bd4d-c6483c9accc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19e320e-7b6e-40d1-a123-78414a5624f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19e320e-7b6e-40d1-a123-78414a5624f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781796171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4e1ec5-f75c-4105-95bd-a93d68107bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4378ae6814a640818da5793f9ce959bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:04Z,use_quota=True,user_id='c7730f3c2e8d4c878a79dfb8dd81a056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d767836f-3f0e-44c3-9079-abd6e49730e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d767836f-3f0e-44c3-9079-abd6e49730e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aab6cf0-0692-4471-878f-777ff3737dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aab6cf0-0692-4471-878f-777ff3737dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4e1ec5-f75c-4105-95bd-a93d68107bf0', 'volume_name': 'volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d174c56-a931-479b-b775-bc4ab4dcf63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d174c56-a931-479b-b775-bc4ab4dcf63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218d04c2-6724-4e61-8088-19de014bbfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:03 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Volume 7b4e1ec5-f75c-4105-95bd-a93d68107bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0', 'volume_size': 1} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781796171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4e1ec5-f75c-4105-95bd-a93d68107bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4378ae6814a640818da5793f9ce959bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:04Z,use_quota=True,user_id='c7730f3c2e8d4c878a79dfb8dd81a056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Creating volume 7b4e1ec5-f75c-4105-95bd-a93d68107bf0 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:03 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:03 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 1073741824 Sep 16 16:23:03 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:04 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 1073741824" returned: 0 in 0.534s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:04 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 Sep 16 16:23:04 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:04 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0" returned: 0 in 0.344s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218d04c2-6724-4e61-8088-19de014bbfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969f9749-91fc-46db-88db-8aa805baf307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:04 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Volume volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 (7b4e1ec5-f75c-4105-95bd-a93d68107bf0): created successfully Sep 16 16:23:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (969f9749-91fc-46db-88db-8aa805baf307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Flow 'volume_create_manager' (50bdb558-7d34-4a00-bd4d-c6483c9accc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:04 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-92c91277-8bf9-44a2-8638-86b9829548a3 tempest-ProjectReaderTests-919862787 None] Created volume successfully. Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Acquiring lock "cinder-7b4e1ec5-f75c-4105-95bd-a93d68107bf0-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Lock "cinder-7b4e1ec5-f75c-4105-95bd-a93d68107bf0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Acquiring lock "cinder-quobyte-7b4e1ec5-f75c-4105-95bd-a93d68107bf0" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Lock "cinder-quobyte-7b4e1ec5-f75c-4105-95bd-a93d68107bf0" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b981246-cf35-4338-b5c2-998ffa83a239]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:06 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 Sep 16 16:23:06 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:06 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0" returned: 0 in 0.455s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:06 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0 Sep 16 16:23:06 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:06 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7b4e1ec5-f75c-4105-95bd-a93d68107bf0" returned: 0 in 0.275s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Lock "cinder-quobyte-7b4e1ec5-f75c-4105-95bd-a93d68107bf0" released by "delete_volume" :: held 0.783s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Created reservations ['4c38d7b7-d735-4496-bebd-27fd495bdf58', '57ac0cca-63d1-4a10-acd2-5b0d8bc76887', 'd2049f84-4bb4-4639-b77c-eecb79339069', '748c10b0-d77d-4823-a088-68f333afecf3'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:07 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:07 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:07 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.353s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Deleted volume successfully. Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-235e3254-ec23-4a10-99e1-3440cc158158 tempest-ProjectReaderTests-919862787 None] Lock "cinder-7b4e1ec5-f75c-4105-95bd-a93d68107bf0-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Flow 'volume_create_manager' (ce43e57a-9692-4ff0-bf7a-5d707890349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6a91a4-38f2-4fd8-9a21-a10e5f1adfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6a91a4-38f2-4fd8-9a21-a10e5f1adfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1572576988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b60ad3-8a6e-4b11-a8f2-1ee311232265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4378ae6814a640818da5793f9ce959bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:08Z,use_quota=True,user_id='c7730f3c2e8d4c878a79dfb8dd81a056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94131d33-f0df-47d4-9991-06f59bdaf105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94131d33-f0df-47d4-9991-06f59bdaf105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16408f8e-acc6-42fe-83a8-becd143b5ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16408f8e-acc6-42fe-83a8-becd143b5ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b60ad3-8a6e-4b11-a8f2-1ee311232265', 'volume_name': 'volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f04d668-0c90-4058-a766-37ea85116ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f04d668-0c90-4058-a766-37ea85116ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d36ea0-436f-4cdb-bd0f-3c50d481aeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:08 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Volume 81b60ad3-8a6e-4b11-a8f2-1ee311232265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265', 'volume_size': 1} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1572576988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b60ad3-8a6e-4b11-a8f2-1ee311232265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4378ae6814a640818da5793f9ce959bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:08Z,use_quota=True,user_id='c7730f3c2e8d4c878a79dfb8dd81a056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Creating volume 81b60ad3-8a6e-4b11-a8f2-1ee311232265 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:08 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:08 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 1073741824 Sep 16 16:23:08 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:08 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 1073741824" returned: 0 in 0.570s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:08 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 Sep 16 16:23:08 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:08 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265" returned: 0 in 0.289s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d36ea0-436f-4cdb-bd0f-3c50d481aeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347571b7-c250-46ba-bbaf-161d9eee7f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Volume volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 (81b60ad3-8a6e-4b11-a8f2-1ee311232265): created successfully Sep 16 16:23:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347571b7-c250-46ba-bbaf-161d9eee7f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Flow 'volume_create_manager' (ce43e57a-9692-4ff0-bf7a-5d707890349b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c5663895-4cad-44f8-beb9-7e816ff39c81 tempest-ProjectReaderTests-919862787 None] Created volume successfully. Sep 16 16:23:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Acquiring lock "cinder-81b60ad3-8a6e-4b11-a8f2-1ee311232265-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Lock "cinder-81b60ad3-8a6e-4b11-a8f2-1ee311232265-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Acquiring lock "cinder-quobyte-81b60ad3-8a6e-4b11-a8f2-1ee311232265" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Lock "cinder-quobyte-81b60ad3-8a6e-4b11-a8f2-1ee311232265" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:10 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f0fc75-4341-45a5-8d56-1732104e7a63]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:10 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 Sep 16 16:23:10 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:10 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265" returned: 0 in 0.475s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:10 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265 Sep 16 16:23:10 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:11 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-81b60ad3-8a6e-4b11-a8f2-1ee311232265" returned: 0 in 0.312s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Lock "cinder-quobyte-81b60ad3-8a6e-4b11-a8f2-1ee311232265" released by "delete_volume" :: held 0.850s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Created reservations ['1b886c8b-22f7-44e7-821e-2f61226ef772', '751c73ab-0aea-4e5f-9ec4-3c4001d09dff', '0478ccd7-5cd6-4999-9bd5-84344e8981cc', '9dafcfb7-bfcf-4bbd-ad9e-0bfba033d727'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:11 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:11 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:11 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.373s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:11 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Deleted volume successfully. Sep 16 16:23:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9696231c-91ec-46f6-9a1b-4923e6d6568a tempest-ProjectReaderTests-919862787 None] Lock "cinder-81b60ad3-8a6e-4b11-a8f2-1ee311232265-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Flow 'volume_create_manager' (2a184407-9906-469b-88bc-ce749579d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b681a5-5152-4a22-bc09-4e4ed3cf8e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6b681a5-5152-4a22-bc09-4e4ed3cf8e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1326739753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223cd765-1c5b-449f-92f9-ca0ccbc61678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1c4bc0c7854827ab30eedda5d72412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:12Z,use_quota=True,user_id='3caed56d3c374f4d87cc1472b62449cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2112ad8-5750-4133-950d-892406d77145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2112ad8-5750-4133-950d-892406d77145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf6ef3a-5bb0-45c0-95ad-18c3c5a048c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf6ef3a-5bb0-45c0-95ad-18c3c5a048c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223cd765-1c5b-449f-92f9-ca0ccbc61678', 'volume_name': 'volume-223cd765-1c5b-449f-92f9-ca0ccbc61678', 'volume_size': 2}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70455663-94c5-473f-bbe1-80f1bc0ff7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70455663-94c5-473f-bbe1-80f1bc0ff7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2fc9da-e3be-4682-ba7f-7ffe21b84023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Volume 223cd765-1c5b-449f-92f9-ca0ccbc61678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223cd765-1c5b-449f-92f9-ca0ccbc61678', 'volume_size': 2} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1326739753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223cd765-1c5b-449f-92f9-ca0ccbc61678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1c4bc0c7854827ab30eedda5d72412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:12Z,use_quota=True,user_id='3caed56d3c374f4d87cc1472b62449cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Creating volume 223cd765-1c5b-449f-92f9-ca0ccbc61678 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:12 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 2147483648 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:12 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 2147483648 Sep 16 16:23:12 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Flow 'volume_create_manager' (ba69b458-582d-4b64-bc5c-27bb738c07bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bcf4b8-d81b-4d76-9ae4-cc258415dbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75bcf4b8-d81b-4d76-9ae4-cc258415dbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-151354266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce7488f-c616-4303-a7aa-4b4aa6dbac4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4378ae6814a640818da5793f9ce959bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:12Z,use_quota=True,user_id='c7730f3c2e8d4c878a79dfb8dd81a056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe016379-967d-4b5b-920d-5460c26e68f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe016379-967d-4b5b-920d-5460c26e68f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dba776-2765-43a7-b3a4-9c8c90e5c340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dba776-2765-43a7-b3a4-9c8c90e5c340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce7488f-c616-4303-a7aa-4b4aa6dbac4b', 'volume_name': 'volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d183946-e017-45a8-894b-b5e86af22cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d183946-e017-45a8-894b-b5e86af22cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea2e443-2255-4333-9a05-663f642b9fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:12 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Volume 6ce7488f-c616-4303-a7aa-4b4aa6dbac4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b', 'volume_size': 1} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:12 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 2147483648" returned: 0 in 0.584s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:12 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 Sep 16 16:23:12 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:13 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678" returned: 0 in 0.244s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-151354266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce7488f-c616-4303-a7aa-4b4aa6dbac4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4378ae6814a640818da5793f9ce959bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:12Z,use_quota=True,user_id='c7730f3c2e8d4c878a79dfb8dd81a056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Creating volume 6ce7488f-c616-4303-a7aa-4b4aa6dbac4b {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:13 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2fc9da-e3be-4682-ba7f-7ffe21b84023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223cd765-1c5b-449f-92f9-ca0ccbc61678', 'volume_size': 2}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48df62d-2e7e-41f8-bd1b-7deabe154571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:13 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b 1073741824 Sep 16 16:23:13 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:13 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Volume volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 (223cd765-1c5b-449f-92f9-ca0ccbc61678): created successfully Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48df62d-2e7e-41f8-bd1b-7deabe154571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Flow 'volume_create_manager' (2a184407-9906-469b-88bc-ce749579d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:13 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-98be6968-49a1-4870-a431-bb2eec3cdcd9 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Created volume successfully. Sep 16 16:23:13 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b 1073741824" returned: 0 in 0.567s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:13 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b Sep 16 16:23:13 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:13 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b" returned: 0 in 0.268s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea2e443-2255-4333-9a05-663f642b9fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fab6a7-89cd-4269-b9a7-32b6289286b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:13 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Volume volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b (6ce7488f-c616-4303-a7aa-4b4aa6dbac4b): created successfully Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fab6a7-89cd-4269-b9a7-32b6289286b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Flow 'volume_create_manager' (ba69b458-582d-4b64-bc5c-27bb738c07bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a80d264c-70eb-4736-9981-63aa50d29e18 tempest-ProjectReaderTests-919862787 None] Created volume successfully. Sep 16 16:23:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Creating offline snapshot 8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 of volume 223cd765-1c5b-449f-92f9-ca0ccbc61678 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:23:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f968786-eb34-4652-8577-cb52413b4949]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:14 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 Sep 16 16:23:14 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:14 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678" returned: 0 in 0.405s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 2G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:14 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 2G Sep 16 16:23:14 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:15 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 2G" returned: 0 in 0.487s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:15 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 Sep 16 16:23:15 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Acquiring lock "cinder-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Lock "cinder-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Acquiring lock "cinder-quobyte-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Lock "cinder-quobyte-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e179b30f-e261-4823-b5ab-17bc120f4463]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:15 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4" returned: 0 in 0.368s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:15 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 is being set with open permissions: ugo+rw Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:15 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b Sep 16 16:23:15 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:15 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 Sep 16 16:23:15 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:15 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b" returned: 0 in 0.481s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:15 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b Sep 16 16:23:15 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:15 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4" returned: 0 in 0.395s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:15 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.info Sep 16 16:23:15 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:16 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b" returned: 0 in 0.288s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Lock "cinder-quobyte-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b" released by "delete_volume" :: held 0.824s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:16 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.info" returned: 0 in 0.301s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:16 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.info is being set with open permissions: ugo+rw Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Created reservations ['00a5d0a9-70cf-4edd-a323-d79136d3f0b6', 'cfb18706-7ddb-434d-adbc-63dcf7546abe', 'b19ead4c-3c4e-4226-8408-5b4ec6febb78', 'ba8c65fb-7c4e-4ed9-88b2-676b6fb601e3'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:16 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.info Sep 16 16:23:16 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:16 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:16 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:16 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.info" returned: 0 in 0.389s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7c24dd02-5e9d-4402-aa5a-2b7290721563 tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Create snapshot completed successfully Sep 16 16:23:16 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.345s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Deleted volume successfully. Sep 16 16:23:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de0678ba-7908-4461-a074-c696f84b4dda tempest-ProjectReaderTests-919862787 None] Lock "cinder-6ce7488f-c616-4303-a7aa-4b4aa6dbac4b-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Flow 'volume_create_manager' (f07ab061-8bd7-4483-9267-faec8dc91477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c7b9c0-b74d-4b2d-9283-580f47635fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c7b9c0-b74d-4b2d-9283-580f47635fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2119105427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add464aa-72aa-4ccb-ab20-ab561a89dfd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4378ae6814a640818da5793f9ce959bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:17Z,use_quota=True,user_id='c7730f3c2e8d4c878a79dfb8dd81a056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91787bc2-3e2d-4e35-8a63-2992857ec24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91787bc2-3e2d-4e35-8a63-2992857ec24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223a7b72-e010-4ce4-9f5b-7a3a82c222a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223a7b72-e010-4ce4-9f5b-7a3a82c222a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add464aa-72aa-4ccb-ab20-ab561a89dfd5', 'volume_name': 'volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7642b28e-f55c-4045-9e96-24086b1aa326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7642b28e-f55c-4045-9e96-24086b1aa326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9540850-18a0-4fc6-a691-29f2182237db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:17 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Volume add464aa-72aa-4ccb-ab20-ab561a89dfd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5', 'volume_size': 1} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2119105427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add464aa-72aa-4ccb-ab20-ab561a89dfd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4378ae6814a640818da5793f9ce959bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:17Z,use_quota=True,user_id='c7730f3c2e8d4c878a79dfb8dd81a056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Creating volume add464aa-72aa-4ccb-ab20-ab561a89dfd5 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:17 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:17 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 1073741824 Sep 16 16:23:17 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Acquiring lock "cinder-8ef9fe47-9660-49ca-9c26-829cdc7ba9f4-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-8ef9fe47-9660-49ca-9c26-829cdc7ba9f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Acquiring lock "cinder-quobyte-223cd765-1c5b-449f-92f9-ca0ccbc61678" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-quobyte-223cd765-1c5b-449f-92f9-ca0ccbc61678" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Acquiring lock "cinder-quobyte-8ef9fe47-9660-49ca-9c26-829cdc7ba9f4" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-quobyte-8ef9fe47-9660-49ca-9c26-829cdc7ba9f4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Deleting offline snapshot 8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 of volume 223cd765-1c5b-449f-92f9-ca0ccbc61678 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] snapshot_file for this snap is: volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64132a5-addf-4b34-b55e-52e3e5027112]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:17 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 Sep 16 16:23:17 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:17 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 1073741824" returned: 0 in 0.511s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:17 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 Sep 16 16:23:17 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:18 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4" returned: 0 in 0.410s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-223cd765-1c5b-449f-92f9-ca0ccbc61678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:23:18 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5" returned: 0 in 0.274s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9540850-18a0-4fc6-a691-29f2182237db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4370cfe4-6c7e-4926-ae2b-66a5738f5971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[820db5a3-dbcb-4440-9018-7c99f1af5b03]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:18 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Volume volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 (add464aa-72aa-4ccb-ab20-ab561a89dfd5): created successfully Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4370cfe4-6c7e-4926-ae2b-66a5738f5971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Flow 'volume_create_manager' (f07ab061-8bd7-4483-9267-faec8dc91477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-39d1e761-4722-4b2e-b809-749d6c44c969 tempest-ProjectReaderTests-919862787 None] Created volume successfully. Sep 16 16:23:18 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 Sep 16 16:23:18 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:18 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678" returned: 0 in 0.449s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:18 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 Sep 16 16:23:18 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:18 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4" returned: 0 in 0.401s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:18 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4 Sep 16 16:23:18 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:19 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678.8ef9fe47-9660-49ca-9c26-829cdc7ba9f4" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-quobyte-8ef9fe47-9660-49ca-9c26-829cdc7ba9f4" released by "_delete_snapshot" :: held 1.696s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Acquiring lock "cinder-add464aa-72aa-4ccb-ab20-ab561a89dfd5-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-quobyte-223cd765-1c5b-449f-92f9-ca0ccbc61678" released by "delete_snapshot" :: held 1.728s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Lock "cinder-add464aa-72aa-4ccb-ab20-ab561a89dfd5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Acquiring lock "cinder-quobyte-add464aa-72aa-4ccb-ab20-ab561a89dfd5" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Lock "cinder-quobyte-add464aa-72aa-4ccb-ab20-ab561a89dfd5" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Created reservations ['8cfdff33-c8bb-427d-a0bc-4e20bdfe9b72', 'c3e7f9db-84a5-4eec-8ec7-c08db86716e2', '2fcefb06-7739-4761-8d8a-2eeebe8b89fa', 'ff22e584-e2d1-4b37-a52f-dc399a4458c0'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[42de6c61-2d00-4e31-9c6a-034200a573e6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:19 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Delete snapshot completed successfully. Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7ef03cb6-5b05-40d4-ba74-5296f514338e tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-8ef9fe47-9660-49ca-9c26-829cdc7ba9f4-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:19 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 Sep 16 16:23:19 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Acquiring lock "cinder-223cd765-1c5b-449f-92f9-ca0ccbc61678-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-223cd765-1c5b-449f-92f9-ca0ccbc61678-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Acquiring lock "cinder-quobyte-223cd765-1c5b-449f-92f9-ca0ccbc61678" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-quobyte-223cd765-1c5b-449f-92f9-ca0ccbc61678" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90ef896-056f-4572-8564-4abbdde31cf0]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:20 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5" returned: 0 in 0.604s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:20 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5 Sep 16 16:23:20 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:20 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 Sep 16 16:23:20 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:20 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-add464aa-72aa-4ccb-ab20-ab561a89dfd5" returned: 0 in 0.363s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Lock "cinder-quobyte-add464aa-72aa-4ccb-ab20-ab561a89dfd5" released by "delete_volume" :: held 1.046s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:20 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678" returned: 0 in 0.479s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:20 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678 Sep 16 16:23:20 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Created reservations ['58dd6c79-c749-487a-831a-7c4e5d39ca8c', '8e1c27d2-e84b-45e3-b7da-f6e9413323dd', 'b0ddc191-c439-416a-847b-cabd4af2f117', '26136eb7-b557-4d26-a70e-ee039e978aef'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:20 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:20 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:20 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-223cd765-1c5b-449f-92f9-ca0ccbc61678" returned: 0 in 0.370s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-quobyte-223cd765-1c5b-449f-92f9-ca0ccbc61678" released by "delete_volume" :: held 0.960s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Created reservations ['423b6922-339e-4d96-bb92-92afba19125d', 'caafadc3-9a1c-4548-879d-19617a104642', '7fcf7f37-e964-4a30-9a18-c0df0e8d711c', 'bff29cca-74c2-4692-8e4e-e72ac220c51c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:21 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.395s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:21 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Deleted volume successfully. Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f56c2f12-8692-4250-874a-5100b2bfcf6a tempest-ProjectReaderTests-919862787 None] Lock "cinder-add464aa-72aa-4ccb-ab20-ab561a89dfd5-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:21 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:21 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:21 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.427s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:21 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Deleted volume successfully. Sep 16 16:23:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-016597a8-a615-48d3-8dc3-8285372811aa tempest-VolumesSnapshotNegativeTestJSON-2048297280 None] Lock "cinder-223cd765-1c5b-449f-92f9-ca0ccbc61678-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (33a4e4df-13f8-4c2a-bb1c-9bc791e2f704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1072cac-2226-4a85-b077-4350d920c2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1072cac-2226-4a85-b077-4350d920c2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2142937158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3da69f-a0d6-43a5-a053-4f5facbacc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:28Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765d4223-9e50-4b92-ae26-b03922f25c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765d4223-9e50-4b92-ae26-b03922f25c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23993cd-d0ae-48ec-80b7-dfd4a3984a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23993cd-d0ae-48ec-80b7-dfd4a3984a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3da69f-a0d6-43a5-a053-4f5facbacc94', 'volume_name': 'volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e207006-8b92-4d0c-a79c-c10fbfa64910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e207006-8b92-4d0c-a79c-c10fbfa64910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a87676-6276-40d5-82cb-a0f1383a7bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:28 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Volume ed3da69f-a0d6-43a5-a053-4f5facbacc94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94', 'volume_size': 1} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2142937158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3da69f-a0d6-43a5-a053-4f5facbacc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:28Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Creating volume ed3da69f-a0d6-43a5-a053-4f5facbacc94 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:28 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:28 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 1073741824 Sep 16 16:23:28 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:28 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 1073741824" returned: 0 in 0.626s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:28 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 Sep 16 16:23:28 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:29 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94" returned: 0 in 0.270s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a87676-6276-40d5-82cb-a0f1383a7bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289c561d-0519-47f0-98c8-31a1c279a77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:29 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Volume volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 (ed3da69f-a0d6-43a5-a053-4f5facbacc94): created successfully Sep 16 16:23:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289c561d-0519-47f0-98c8-31a1c279a77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (33a4e4df-13f8-4c2a-bb1c-9bc791e2f704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f57a21b7-1f3c-4289-9492-d43f96d3cd97 tempest-VolumesActionsTest-247282924 None] Created volume successfully. Sep 16 16:23:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31cf48d8-7942-472a-96c0-debb5d50ab0d tempest-VolumesActionsTest-247282924 None] Acquiring lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94" by "attach_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31cf48d8-7942-472a-96c0-debb5d50ab0d tempest-VolumesActionsTest-247282924 None] Lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94" acquired by "attach_volume" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:30 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-31cf48d8-7942-472a-96c0-debb5d50ab0d tempest-VolumesActionsTest-247282924 None] Attaching volume ed3da69f-a0d6-43a5-a053-4f5facbacc94 to instance cd404229-afa8-4221-9292-e5d8b2803ca2 at mountpoint /dev/vdb on host None. Sep 16 16:23:30 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-31cf48d8-7942-472a-96c0-debb5d50ab0d tempest-VolumesActionsTest-247282924 None] Attach volume completed successfully. Sep 16 16:23:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31cf48d8-7942-472a-96c0-debb5d50ab0d tempest-VolumesActionsTest-247282924 None] Lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94" released by "attach_volume" :: held 0.140s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1bf851d9-0340-483e-a3e1-a0a2d39dc5be tempest-VolumesActionsTest-2008467818 None] Terminate volume connection completed successfully. Sep 16 16:23:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1bf851d9-0340-483e-a3e1-a0a2d39dc5be tempest-VolumesActionsTest-2008467818 None] Acquiring lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94-detach_volume" by "detach_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1bf851d9-0340-483e-a3e1-a0a2d39dc5be tempest-VolumesActionsTest-2008467818 None] Lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1bf851d9-0340-483e-a3e1-a0a2d39dc5be tempest-VolumesActionsTest-2008467818 None] Detaching volume ed3da69f-a0d6-43a5-a053-4f5facbacc94 from instance cd404229-afa8-4221-9292-e5d8b2803ca2. Sep 16 16:23:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1bf851d9-0340-483e-a3e1-a0a2d39dc5be tempest-VolumesActionsTest-2008467818 None] Detach volume completed successfully. Sep 16 16:23:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1bf851d9-0340-483e-a3e1-a0a2d39dc5be tempest-VolumesActionsTest-2008467818 None] Lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-64980f01-c9c5-4653-83f4-9b8218663342 tempest-VolumesActionsTest-247282924 None] Acquiring lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94-detach_volume" by "detach_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-64980f01-c9c5-4653-83f4-9b8218663342 tempest-VolumesActionsTest-247282924 None] Lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-64980f01-c9c5-4653-83f4-9b8218663342 tempest-VolumesActionsTest-247282924 None] Volume detach called, but volume not attached. Sep 16 16:23:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-64980f01-c9c5-4653-83f4-9b8218663342 tempest-VolumesActionsTest-247282924 None] Lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Acquiring lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Acquiring lock "cinder-quobyte-ed3da69f-a0d6-43a5-a053-4f5facbacc94" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Lock "cinder-quobyte-ed3da69f-a0d6-43a5-a053-4f5facbacc94" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:32 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8a36d2-4ce9-431c-bcb2-a9d165130939]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:32 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 Sep 16 16:23:32 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:32 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94" returned: 0 in 0.462s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:32 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94 Sep 16 16:23:32 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:33 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ed3da69f-a0d6-43a5-a053-4f5facbacc94" returned: 0 in 0.311s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Lock "cinder-quobyte-ed3da69f-a0d6-43a5-a053-4f5facbacc94" released by "delete_volume" :: held 0.837s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=140,cinder:SELECT=107,cinder:INSERT=31,cinder:DELETE=8 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=111,cinder:INSERT=39,cinder:UPDATE=139,cinder:DELETE=15 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Created reservations ['715208e9-bbff-42b5-a4e9-45c61464a7ee', 'ba23aae5-6694-44fb-b2b0-e8c969be0083', 'ee238ddb-91d2-4152-b0a7-fc4842079ca3', '241e63ff-e121-4514-a02e-a2d4a779c6ec'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:33 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:33 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:33 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:33 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Deleted volume successfully. Sep 16 16:23:33 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-31aecab8-de14-4af6-b94f-37bf20df58eb tempest-VolumesActionsTest-247282924 None] Lock "cinder-ed3da69f-a0d6-43a5-a053-4f5facbacc94-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (7c34c9d0-b4fd-4aaf-8f2f-b62720a6d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f331c915-aa44-47dd-9dc9-8d024d2cb8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f331c915-aa44-47dd-9dc9-8d024d2cb8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1561129345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7709bd87-7f12-4246-8899-b7c4877498cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:37Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5b6a7f-f8fc-42cf-bf83-79ac53700e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5b6a7f-f8fc-42cf-bf83-79ac53700e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ed08a1-b2c3-4ceb-95d7-2694cb5b3e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ed08a1-b2c3-4ceb-95d7-2694cb5b3e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7709bd87-7f12-4246-8899-b7c4877498cd', 'volume_name': 'volume-7709bd87-7f12-4246-8899-b7c4877498cd', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33cd806a-ad21-40dc-8d62-3010003e922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33cd806a-ad21-40dc-8d62-3010003e922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb11d0f9-8aeb-4c44-80b0-f781367b90c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Volume 7709bd87-7f12-4246-8899-b7c4877498cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7709bd87-7f12-4246-8899-b7c4877498cd', 'volume_size': 1} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1561129345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7709bd87-7f12-4246-8899-b7c4877498cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:37Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Creating volume 7709bd87-7f12-4246-8899-b7c4877498cd {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:37 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:37 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd 1073741824 Sep 16 16:23:37 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:37 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd 1073741824" returned: 0 in 0.499s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:37 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd Sep 16 16:23:37 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:38 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd" returned: 0 in 0.276s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb11d0f9-8aeb-4c44-80b0-f781367b90c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7709bd87-7f12-4246-8899-b7c4877498cd', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92817e24-5b07-437c-a565-d626ec520ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:38 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Volume volume-7709bd87-7f12-4246-8899-b7c4877498cd (7709bd87-7f12-4246-8899-b7c4877498cd): created successfully Sep 16 16:23:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92817e24-5b07-437c-a565-d626ec520ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (7c34c9d0-b4fd-4aaf-8f2f-b62720a6d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-95745597-87b9-4040-8795-e7e6a148b961 tempest-VolumesActionsTest-247282924 None] Created volume successfully. Sep 16 16:23:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Acquiring lock "cinder-7709bd87-7f12-4246-8899-b7c4877498cd-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-7709bd87-7f12-4246-8899-b7c4877498cd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Acquiring lock "cinder-quobyte-7709bd87-7f12-4246-8899-b7c4877498cd" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-quobyte-7709bd87-7f12-4246-8899-b7c4877498cd" acquired by "delete_volume" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:39 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[55529587-b6e7-4fcc-83d0-e677d92f0671]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:39 devstack sudo[101723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd Sep 16 16:23:39 devstack sudo[101723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:39 devstack sudo[101723]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd" returned: 0 in 0.435s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:39 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd Sep 16 16:23:39 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:40 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-7709bd87-7f12-4246-8899-b7c4877498cd" returned: 0 in 0.272s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-quobyte-7709bd87-7f12-4246-8899-b7c4877498cd" released by "delete_volume" :: held 0.756s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Created reservations ['862d92f1-d0c2-4606-952a-cdbd477a8c63', 'e8bccac2-16df-4841-ae7a-b023159858f0', '9baf2971-7001-49f5-8d81-38544935b052', 'cf36c703-fa09-4f4a-be97-0a2f0692079c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:40 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:40 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:40 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.312s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Deleted volume successfully. Sep 16 16:23:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c18cb5ef-c7bb-4786-afe4-ee97bf37e830 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-7709bd87-7f12-4246-8899-b7c4877498cd-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (ed3a941d-98be-459e-82bb-f0ba992f7ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c9cd2-6561-4e47-883c-47e4e2e7a16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6c9cd2-6561-4e47-883c-47e4e2e7a16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-380628300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7136ddf-757a-4c3d-ad20-6588fb0a9b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:41Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf76722-4f22-45a8-ba0f-892f85ff46d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf76722-4f22-45a8-ba0f-892f85ff46d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a19c10e-340d-4fee-a91e-f40256900323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a19c10e-340d-4fee-a91e-f40256900323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7136ddf-757a-4c3d-ad20-6588fb0a9b47', 'volume_name': 'volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb69138d-1088-439f-b281-b8b47bf56b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb69138d-1088-439f-b281-b8b47bf56b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81a9772-a454-4c7e-882a-f3101b7104ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:41 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Volume f7136ddf-757a-4c3d-ad20-6588fb0a9b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47', 'volume_size': 1} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-380628300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7136ddf-757a-4c3d-ad20-6588fb0a9b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:41Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Creating volume f7136ddf-757a-4c3d-ad20-6588fb0a9b47 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:41 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:41 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 1073741824 Sep 16 16:23:41 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:41 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:41 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:41 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 1073741824" returned: 0 in 0.547s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:41 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 Sep 16 16:23:41 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:42 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.314s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:23:42 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47" returned: 0 in 0.266s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81a9772-a454-4c7e-882a-f3101b7104ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599cda90-4532-4241-aa47-dbbdb6c2320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:42 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Volume volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 (f7136ddf-757a-4c3d-ad20-6588fb0a9b47): created successfully Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599cda90-4532-4241-aa47-dbbdb6c2320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (ed3a941d-98be-459e-82bb-f0ba992f7ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4fb3ab11-78c8-4789-9168-cb1184be6799 tempest-VolumesActionsTest-247282924 None] Created volume successfully. Sep 16 16:23:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Acquiring lock "cinder-f7136ddf-757a-4c3d-ad20-6588fb0a9b47-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Lock "cinder-f7136ddf-757a-4c3d-ad20-6588fb0a9b47-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Acquiring lock "cinder-quobyte-f7136ddf-757a-4c3d-ad20-6588fb0a9b47" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Lock "cinder-quobyte-f7136ddf-757a-4c3d-ad20-6588fb0a9b47" acquired by "delete_volume" :: waited 0.014s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:43 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ea51e5-7eb6-470e-b035-e914a2445d51]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:43 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 Sep 16 16:23:43 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:44 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47" returned: 0 in 0.415s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:44 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47 Sep 16 16:23:44 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:44 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f7136ddf-757a-4c3d-ad20-6588fb0a9b47" returned: 0 in 0.257s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Lock "cinder-quobyte-f7136ddf-757a-4c3d-ad20-6588fb0a9b47" released by "delete_volume" :: held 0.722s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Created reservations ['b33190f2-cbb6-418f-84de-a4a984e57c15', '761c38f5-f6e1-41e6-9d16-73a3f68b8795', '0cae98a2-3be3-4a1c-8a86-aafb28d8e912', '5e665a3c-a96c-4352-bbdc-f26951e06519'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:44 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:44 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:44 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.270s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Deleted volume successfully. Sep 16 16:23:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-520824d9-7fb3-4952-964d-2f292dc4f7be tempest-VolumesActionsTest-2008467818 None] Lock "cinder-f7136ddf-757a-4c3d-ad20-6588fb0a9b47-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (2705efda-9ae1-4bd5-9c70-01dbf5a739e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6ceae2-96d6-487e-8b49-29b974741c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6ceae2-96d6-487e-8b49-29b974741c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1911834504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce06b91a-5921-40e8-a9a9-a868305990e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:45Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acd02c3-91aa-4110-8735-8198667c8c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acd02c3-91aa-4110-8735-8198667c8c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6534f9f8-3ecb-4354-b120-b2e255ea169b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6534f9f8-3ecb-4354-b120-b2e255ea169b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce06b91a-5921-40e8-a9a9-a868305990e8', 'volume_name': 'volume-ce06b91a-5921-40e8-a9a9-a868305990e8', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a926ae-50cc-4f41-a2cf-99f95e45725e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a926ae-50cc-4f41-a2cf-99f95e45725e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c40e37-49e0-48e9-9bb6-c3fc9f7214ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:45 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Volume ce06b91a-5921-40e8-a9a9-a868305990e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce06b91a-5921-40e8-a9a9-a868305990e8', 'volume_size': 1} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1911834504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce06b91a-5921-40e8-a9a9-a868305990e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:45Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Creating volume ce06b91a-5921-40e8-a9a9-a868305990e8 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:45 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:45 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8 1073741824 Sep 16 16:23:45 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:45 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8 1073741824" returned: 0 in 0.514s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:45 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8 Sep 16 16:23:45 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:46 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8" returned: 0 in 0.282s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c40e37-49e0-48e9-9bb6-c3fc9f7214ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce06b91a-5921-40e8-a9a9-a868305990e8', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d2903f-5cdb-4c2c-9446-aca2ddc2f5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:46 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Volume volume-ce06b91a-5921-40e8-a9a9-a868305990e8 (ce06b91a-5921-40e8-a9a9-a868305990e8): created successfully Sep 16 16:23:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d2903f-5cdb-4c2c-9446-aca2ddc2f5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (2705efda-9ae1-4bd5-9c70-01dbf5a739e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b3758b1c-5721-480d-bee0-3ba76c682ea9 tempest-VolumesActionsTest-247282924 None] Created volume successfully. Sep 16 16:23:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Acquiring lock "cinder-ce06b91a-5921-40e8-a9a9-a868305990e8-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-ce06b91a-5921-40e8-a9a9-a868305990e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Acquiring lock "cinder-quobyte-ce06b91a-5921-40e8-a9a9-a868305990e8" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-quobyte-ce06b91a-5921-40e8-a9a9-a868305990e8" acquired by "delete_volume" :: waited 0.014s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:47 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc248777-1b10-454b-bff2-b6c19ad2435b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:47 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8 Sep 16 16:23:47 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:48 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8" returned: 0 in 0.421s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:48 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8 Sep 16 16:23:48 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:48 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce06b91a-5921-40e8-a9a9-a868305990e8" returned: 0 in 0.281s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-quobyte-ce06b91a-5921-40e8-a9a9-a868305990e8" released by "delete_volume" :: held 0.768s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Created reservations ['3c9a3755-6cb7-4c25-b06c-67274608e100', 'e7da7a20-1696-4a4d-b842-6036ce8e8bc9', '347d8b0b-a5e5-48fc-b5e5-d4712c0a9e50', 'a12163e9-ba81-45e0-af3c-fb0888e2d335'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:48 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:48 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:49 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.426s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Deleted volume successfully. Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c31c7e85-e95d-4f46-a263-59cc2540fc05 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-ce06b91a-5921-40e8-a9a9-a868305990e8-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (bf90f6b5-c19d-482e-90ee-979269b5d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc25d83-8fa4-4d8f-b987-ba07c47af8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc25d83-8fa4-4d8f-b987-ba07c47af8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1080914897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbeb5739-36eb-4462-955d-66e934f31436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:49Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780c5f10-2d3d-4ba3-83b9-14501577d759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (780c5f10-2d3d-4ba3-83b9-14501577d759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a9f28c-9783-4fd2-98b8-b204d0bdf158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a9f28c-9783-4fd2-98b8-b204d0bdf158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbeb5739-36eb-4462-955d-66e934f31436', 'volume_name': 'volume-cbeb5739-36eb-4462-955d-66e934f31436', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6378b7-628f-4fde-b191-5a4754d5f6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6378b7-628f-4fde-b191-5a4754d5f6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0162f4-da1f-462e-b2b3-097b1a09251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:49 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Volume cbeb5739-36eb-4462-955d-66e934f31436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbeb5739-36eb-4462-955d-66e934f31436', 'volume_size': 1} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1080914897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbeb5739-36eb-4462-955d-66e934f31436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:49Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Creating volume cbeb5739-36eb-4462-955d-66e934f31436 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:49 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:49 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436 1073741824 Sep 16 16:23:49 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:50 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436 1073741824" returned: 0 in 0.520s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:50 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436 Sep 16 16:23:50 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:50 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436" returned: 0 in 0.306s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0162f4-da1f-462e-b2b3-097b1a09251e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbeb5739-36eb-4462-955d-66e934f31436', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897bdee3-a3a2-4918-9db6-680ec96b1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:50 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Volume volume-cbeb5739-36eb-4462-955d-66e934f31436 (cbeb5739-36eb-4462-955d-66e934f31436): created successfully Sep 16 16:23:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897bdee3-a3a2-4918-9db6-680ec96b1b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (bf90f6b5-c19d-482e-90ee-979269b5d78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:50 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-362eb7da-9ccd-4719-8c66-bcbe2fac4917 tempest-VolumesActionsTest-247282924 None] Created volume successfully. Sep 16 16:23:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Acquiring lock "cinder-cbeb5739-36eb-4462-955d-66e934f31436-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-cbeb5739-36eb-4462-955d-66e934f31436-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Acquiring lock "cinder-quobyte-cbeb5739-36eb-4462-955d-66e934f31436" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-quobyte-cbeb5739-36eb-4462-955d-66e934f31436" acquired by "delete_volume" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7824df2-6ce4-4a86-8445-953bc21d2242]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:52 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436 Sep 16 16:23:52 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:52 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436" returned: 0 in 0.400s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:52 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436 Sep 16 16:23:52 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:52 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-cbeb5739-36eb-4462-955d-66e934f31436" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-quobyte-cbeb5739-36eb-4462-955d-66e934f31436" released by "delete_volume" :: held 0.742s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Created reservations ['d7bd99dc-d158-41dc-97b0-2bbf289882d0', 'bab4aa53-1b50-423b-9b6b-7e03022ad369', 'e97e8ab5-e211-4953-88d3-bcc17c627ce7', '9ec5e700-906a-4a49-b566-23cfd19e6360'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:52 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:52 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:53 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.280s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:53 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Deleted volume successfully. Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-7fb1de09-b006-4099-b775-065f902b29a0 tempest-VolumesActionsTest-2008467818 None] Lock "cinder-cbeb5739-36eb-4462-955d-66e934f31436-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (851afba0-1552-42a2-9d13-c533e38bffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e333d0f7-60f1-49b6-ab72-558c8e480ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e333d0f7-60f1-49b6-ab72-558c8e480ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1676240124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0349da8a-e055-4321-a2ee-ae321774e149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:54Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b788f32-1f4c-47d1-b5d6-440edd642e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b788f32-1f4c-47d1-b5d6-440edd642e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ded553-effa-43c9-acb6-c7de60da177d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ded553-effa-43c9-acb6-c7de60da177d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0349da8a-e055-4321-a2ee-ae321774e149', 'volume_name': 'volume-0349da8a-e055-4321-a2ee-ae321774e149', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c596f9-06a8-48a2-b8b6-a21a0aa143e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c596f9-06a8-48a2-b8b6-a21a0aa143e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed309688-1f2d-4e18-b532-bff269ccd523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Volume 0349da8a-e055-4321-a2ee-ae321774e149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0349da8a-e055-4321-a2ee-ae321774e149', 'volume_size': 1} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1676240124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0349da8a-e055-4321-a2ee-ae321774e149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef532f0b244618a9fe3cccd88e43ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:23:54Z,use_quota=True,user_id='7cd5a5034ef94bdd9eb218b7907aacdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Creating volume 0349da8a-e055-4321-a2ee-ae321774e149 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:23:53 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:23:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:53 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149 1073741824 Sep 16 16:23:53 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:54 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149 1073741824" returned: 0 in 0.536s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:54 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149 Sep 16 16:23:54 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:54 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149" returned: 0 in 0.294s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:23:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed309688-1f2d-4e18-b532-bff269ccd523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0349da8a-e055-4321-a2ee-ae321774e149', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe637c3-7b5f-4183-aa2f-9a86a54810fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:23:54 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Volume volume-0349da8a-e055-4321-a2ee-ae321774e149 (0349da8a-e055-4321-a2ee-ae321774e149): created successfully Sep 16 16:23:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe637c3-7b5f-4183-aa2f-9a86a54810fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:23:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Flow 'volume_create_manager' (851afba0-1552-42a2-9d13-c533e38bffc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:23:54 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1f6a9e4e-c7eb-4ebf-b055-bafcc177ccc5 tempest-VolumesActionsTest-247282924 None] Created volume successfully. Sep 16 16:23:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Acquiring lock "cinder-0349da8a-e055-4321-a2ee-ae321774e149-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Lock "cinder-0349da8a-e055-4321-a2ee-ae321774e149-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Acquiring lock "cinder-quobyte-0349da8a-e055-4321-a2ee-ae321774e149" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:23:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Lock "cinder-quobyte-0349da8a-e055-4321-a2ee-ae321774e149" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:23:56 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d15fb43-7b98-4396-869e-ada1d52e3652]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:23:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:56 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149 Sep 16 16:23:56 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:57 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149" returned: 0 in 0.380s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:57 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149 Sep 16 16:23:57 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:57 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0349da8a-e055-4321-a2ee-ae321774e149" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Lock "cinder-quobyte-0349da8a-e055-4321-a2ee-ae321774e149" released by "delete_volume" :: held 0.896s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Created reservations ['a5107bb4-60c0-4843-9174-de90a871a078', '26765831-6a58-4738-a843-a02749b367b9', '1418f7ae-ec15-4e84-ac45-598795209335', '2e19adab-0dd8-4f35-b32b-8e86d65932f7'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:23:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:23:57 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:23:57 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:23:58 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 16 16:23:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.392s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:23:58 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:23:58 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Deleted volume successfully. Sep 16 16:23:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8404ca4-a291-4051-a315-67082652d57a tempest-VolumesActionsTest-247282924 None] Lock "cinder-0349da8a-e055-4321-a2ee-ae321774e149-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:07 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=41,cinder:INSERT=16,cinder:UPDATE=64,cinder:DELETE=7 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:24:08 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=62,cinder:SELECT=36,cinder:DELETE=4,cinder:INSERT=13 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Flow 'volume_create_manager' (a58ff8eb-3b37-4f2c-a2c3-07bde5fabe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39fc300-88ef-423e-a4fc-36f0f9df13a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39fc300-88ef-423e-a4fc-36f0f9df13a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-711938426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34b1700-1e0d-46f4-9585-d11c7c2161b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e95d4d25757445aac37ed9f1d43f041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:22Z,use_quota=True,user_id='3ffbf9caf26c48c896bf0fc1aba00414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67d66f4-0df1-47df-961b-c6fbbbe7eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67d66f4-0df1-47df-961b-c6fbbbe7eae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d0e82-1275-40a2-bd94-9f90f198c906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36d0e82-1275-40a2-bd94-9f90f198c906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34b1700-1e0d-46f4-9585-d11c7c2161b6', 'volume_name': 'volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112e56f3-c46c-488e-a504-86bc9fb3a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112e56f3-c46c-488e-a504-86bc9fb3a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5026152-1033-432f-8e07-98dbca3b2855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:21 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Volume c34b1700-1e0d-46f4-9585-d11c7c2161b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6', 'volume_size': 1} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-711938426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34b1700-1e0d-46f4-9585-d11c7c2161b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e95d4d25757445aac37ed9f1d43f041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:22Z,use_quota=True,user_id='3ffbf9caf26c48c896bf0fc1aba00414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Creating volume c34b1700-1e0d-46f4-9585-d11c7c2161b6 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:24:21 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:24:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:21 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 1073741824 Sep 16 16:24:21 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:22 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 1073741824" returned: 0 in 0.509s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:22 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 Sep 16 16:24:22 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:22 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6" returned: 0 in 0.279s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:24:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5026152-1033-432f-8e07-98dbca3b2855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7041ff-b90b-41a0-b698-180f159d992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:22 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Volume volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 (c34b1700-1e0d-46f4-9585-d11c7c2161b6): created successfully Sep 16 16:24:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7041ff-b90b-41a0-b698-180f159d992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Flow 'volume_create_manager' (a58ff8eb-3b37-4f2c-a2c3-07bde5fabe2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:24:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0de21eab-b537-43a1-8f5e-bef01d58816e tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Created volume successfully. Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Flow 'volume_create_manager' (406aacc7-171e-4e68-88c3-6bd140e0f9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce9a906-a2bd-481c-b4bc-a74e3c638d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce9a906-a2bd-481c-b4bc-a74e3c638d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-564392988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f4611e-36ec-412d-a1e4-d34c4ef52d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dda828b79b74ce48e3ed94ef90005b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:24Z,use_quota=True,user_id='6b4eadfd2c244979bf6820069136088b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4c406e-403f-4453-87bc-ac68ac04f442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4c406e-403f-4453-87bc-ac68ac04f442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4169f8f-3a1c-4a35-b2c9-da93561a3dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4169f8f-3a1c-4a35-b2c9-da93561a3dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f4611e-36ec-412d-a1e4-d34c4ef52d81', 'volume_name': 'volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a6a00-e299-4124-a115-d8e34ce8a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a6a00-e299-4124-a115-d8e34ce8a07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecf50fc-eaa4-4fae-825c-95a84825ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:23 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Volume 23f4611e-36ec-412d-a1e4-d34c4ef52d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81', 'volume_size': 1} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-564392988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f4611e-36ec-412d-a1e4-d34c4ef52d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dda828b79b74ce48e3ed94ef90005b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:24Z,use_quota=True,user_id='6b4eadfd2c244979bf6820069136088b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Creating volume 23f4611e-36ec-412d-a1e4-d34c4ef52d81 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:24:23 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:24:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:23 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 1073741824 Sep 16 16:24:23 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:24 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 1073741824" returned: 0 in 0.496s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:24 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 Sep 16 16:24:24 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:24 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:24:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecf50fc-eaa4-4fae-825c-95a84825ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81057f33-47f4-40fb-adf4-50ad0aaa6973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:24 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Volume volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 (23f4611e-36ec-412d-a1e4-d34c4ef52d81): created successfully Sep 16 16:24:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81057f33-47f4-40fb-adf4-50ad0aaa6973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Flow 'volume_create_manager' (406aacc7-171e-4e68-88c3-6bd140e0f9c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:24:24 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0495c243-1c8b-4eda-9ff7-c356f16fceff tempest-AbsoluteLimitsTests-1683220438 None] Created volume successfully. Sep 16 16:24:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-6a395ada-77bc-412b-aced-3de49073f289 req-3cf00244-1db4-4fab-8171-ac6a1b85b6cd tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-6a395ada-77bc-412b-aced-3de49073f289 req-3cf00244-1db4-4fab-8171-ac6a1b85b6cd tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-6a395ada-77bc-412b-aced-3de49073f289 req-3cf00244-1db4-4fab-8171-ac6a1b85b6cd tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-6a395ada-77bc-412b-aced-3de49073f289 req-3cf00244-1db4-4fab-8171-ac6a1b85b6cd tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca2370ce-b6e8-4d29-88f2-3a65c32f48bb', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:24:25 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-6a395ada-77bc-412b-aced-3de49073f289 req-3cf00244-1db4-4fab-8171-ac6a1b85b6cd tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] attachment_update completed successfully. Sep 16 16:24:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Acquiring lock "cinder-23f4611e-36ec-412d-a1e4-d34c4ef52d81-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Lock "cinder-23f4611e-36ec-412d-a1e4-d34c4ef52d81-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Acquiring lock "cinder-quobyte-23f4611e-36ec-412d-a1e4-d34c4ef52d81" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Lock "cinder-quobyte-23f4611e-36ec-412d-a1e4-d34c4ef52d81" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e025578-9a02-460b-875c-5e0934d4cfee]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:26 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 Sep 16 16:24:26 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:26 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81" returned: 0 in 0.363s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:26 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81 Sep 16 16:24:26 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:26 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-23f4611e-36ec-412d-a1e4-d34c4ef52d81" returned: 0 in 0.255s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Lock "cinder-quobyte-23f4611e-36ec-412d-a1e4-d34c4ef52d81" released by "delete_volume" :: held 0.661s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Created reservations ['216b20c6-088b-4307-93df-0530e7646cd3', 'ebccc816-4441-408d-a9e2-db498a3c192b', '0d20b5f4-8fcd-47bf-a96e-ca00fc53c623', 'e82a01d5-e36b-40fa-9ecd-471daaf27bc9'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:26 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:24:26 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:27 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.309s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:27 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:24:27 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Deleted volume successfully. Sep 16 16:24:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1e47d0a4-d870-4ddf-a957-4c1ea7c28703 tempest-AbsoluteLimitsTests-1683220438 None] Lock "cinder-23f4611e-36ec-412d-a1e4-d34c4ef52d81-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-f89d228d-2677-434b-8107-0b209edede85 req-8634ecfa-9adc-42aa-aff2-cc0793c27aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Terminate volume connection completed successfully. Sep 16 16:24:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-f89d228d-2677-434b-8107-0b209edede85 req-8634ecfa-9adc-42aa-aff2-cc0793c27aa0 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Deleting attachment ca2370ce-b6e8-4d29-88f2-3a65c32f48bb. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:24:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Acquiring lock "cinder-c34b1700-1e0d-46f4-9585-d11c7c2161b6-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "cinder-c34b1700-1e0d-46f4-9585-d11c7c2161b6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Acquiring lock "cinder-quobyte-c34b1700-1e0d-46f4-9585-d11c7c2161b6" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "cinder-quobyte-c34b1700-1e0d-46f4-9585-d11c7c2161b6" acquired by "delete_volume" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:30 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d518e68c-f2f3-4cae-8f44-f178f07ad644]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:30 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 Sep 16 16:24:30 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:30 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6" returned: 0 in 0.412s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:30 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6 Sep 16 16:24:30 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:31 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c34b1700-1e0d-46f4-9585-d11c7c2161b6" returned: 0 in 0.283s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "cinder-quobyte-c34b1700-1e0d-46f4-9585-d11c7c2161b6" released by "delete_volume" :: held 0.753s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Created reservations ['8f87404e-c4bd-4b54-a18b-619889cf87f6', 'f75e8fd8-41ce-4861-83a2-8640b9de7bab', 'f2ba9f9b-267b-4c91-aa74-3c3df5935f12', 'f8de3429-4c25-4679-8298-d69caffecf87'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:31 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:24:31 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:31 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.302s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:24:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Deleted volume successfully. Sep 16 16:24:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6488a05e-280b-4db4-9a17-1d0510d1e399 tempest-TestServerVolumeAttachScenarioOldVersion-1352208581 None] Lock "cinder-c34b1700-1e0d-46f4-9585-d11c7c2161b6-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:32 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:24:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Flow 'volume_create_manager' (9cd424f4-7adf-48a5-9185-2c50a11ebff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:24:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39f4d9f-d457-4499-8ed1-d03116d575db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39f4d9f-d457-4499-8ed1-d03116d575db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1671395570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0603b0de-44c4-4795-a220-4512b77515bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392765b1d02c48b58e13a70acfaa1ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:33Z,use_quota=True,user_id='b5cb9b2df95048678f2e6aeb091caa28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b64f28f-96f8-4d50-b818-0d00a44bb7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b64f28f-96f8-4d50-b818-0d00a44bb7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b8f739-1bc9-4b18-8109-d184c59532c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b8f739-1bc9-4b18-8109-d184c59532c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0603b0de-44c4-4795-a220-4512b77515bd', 'volume_name': 'volume-0603b0de-44c4-4795-a220-4512b77515bd', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb73714-ff84-4326-b285-65d360da8bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb73714-ff84-4326-b285-65d360da8bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121f3747-b521-4ff8-87bb-0ec280e82dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Volume 0603b0de-44c4-4795-a220-4512b77515bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0603b0de-44c4-4795-a220-4512b77515bd', 'volume_size': 1} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1671395570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0603b0de-44c4-4795-a220-4512b77515bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392765b1d02c48b58e13a70acfaa1ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:33Z,use_quota=True,user_id='b5cb9b2df95048678f2e6aeb091caa28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Creating volume 0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:24:33 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:33 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd 1073741824 Sep 16 16:24:33 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:33 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd 1073741824" returned: 0 in 0.583s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:33 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd Sep 16 16:24:33 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:34 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd" returned: 0 in 0.311s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:24:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121f3747-b521-4ff8-87bb-0ec280e82dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0603b0de-44c4-4795-a220-4512b77515bd', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ab541f-ba16-44de-8792-9c694ed931ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Volume volume-0603b0de-44c4-4795-a220-4512b77515bd (0603b0de-44c4-4795-a220-4512b77515bd): created successfully Sep 16 16:24:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ab541f-ba16-44de-8792-9c694ed931ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Flow 'volume_create_manager' (9cd424f4-7adf-48a5-9185-2c50a11ebff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:24:34 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-141b3ade-1580-45b4-9d3d-d1c98eb65f35 tempest-VolumesDeleteCascade-324032045 None] Created volume successfully. Sep 16 16:24:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Creating offline snapshot 6443f807-a15c-4b19-870a-9e009b5f9518 of volume 0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:24:35 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c80ca18-2971-4c86-880c-64245a7df472]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:35 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd Sep 16 16:24:35 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:35 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd" returned: 0 in 0.420s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:35 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 1G Sep 16 16:24:35 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:36 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 1G" returned: 0 in 0.489s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0603b0de-44c4-4795-a220-4512b77515bd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:36 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0603b0de-44c4-4795-a220-4512b77515bd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 Sep 16 16:24:36 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:36 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0603b0de-44c4-4795-a220-4512b77515bd -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518" returned: 0 in 0.343s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:36 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 is being set with open permissions: ugo+rw Sep 16 16:24:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:36 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 Sep 16 16:24:36 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:36 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518" returned: 0 in 0.298s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:36 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.info Sep 16 16:24:36 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:37 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.info" returned: 0 in 0.323s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:37 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.info is being set with open permissions: ugo+rw Sep 16 16:24:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:37 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.info Sep 16 16:24:37 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:37 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.info" returned: 0 in 0.284s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d56617c0-016d-4257-8ab7-81b09984a0a9 tempest-VolumesDeleteCascade-324032045 None] Create snapshot completed successfully Sep 16 16:24:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Creating offline snapshot f700d548-a916-4b1e-9523-7a5630e16e75 of volume 0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:24:38 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9b575-b131-4b92-89fc-5877f93efcef]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:38 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 Sep 16 16:24:38 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:39 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518" returned: 0 in 0.425s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0603b0de-44c4-4795-a220-4512b77515bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:24:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:39 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 1G Sep 16 16:24:39 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:39 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 1G" returned: 0 in 0.566s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:39 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 Sep 16 16:24:39 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:39 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75" returned: 0 in 0.379s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:39 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 is being set with open permissions: ugo+rw Sep 16 16:24:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:40 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 Sep 16 16:24:40 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:40 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.749s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-99cfa62d-3b72-41a0-aeb2-0a4febf5b781 tempest-VolumesDeleteCascade-324032045 None] Create snapshot completed successfully Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-0603b0de-44c4-4795-a220-4512b77515bd-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-0603b0de-44c4-4795-a220-4512b77515bd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Performing cascade delete. {{(pid=86255) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-6443f807-a15c-4b19-870a-9e009b5f9518-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-6443f807-a15c-4b19-870a-9e009b5f9518-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-0603b0de-44c4-4795-a220-4512b77515bd" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-0603b0de-44c4-4795-a220-4512b77515bd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-6443f807-a15c-4b19-870a-9e009b5f9518" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-6443f807-a15c-4b19-870a-9e009b5f9518" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Deleting offline snapshot 6443f807-a15c-4b19-870a-9e009b5f9518 of volume 0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:24:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] snapshot_file for this snap is: volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de7bcd-59c6-4a90-89b7-21544f885b93]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:41 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 Sep 16 16:24:41 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:41 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518" returned: 0 in 0.419s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0603b0de-44c4-4795-a220-4512b77515bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f03474-e2bf-4608-91c3-270b3d8028ad]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:41 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd Sep 16 16:24:41 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:41 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:24:41 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:41 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd" returned: 0 in 0.482s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d418ea-5f79-440b-988e-e3840696b3e9]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:42 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.320s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:24:42 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 Sep 16 16:24:42 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:42 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75" returned: 0 in 0.433s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0603b0de-44c4-4795-a220-4512b77515bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[702bef32-d607-4eb9-ab7a-18306f8aec49]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:42 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 Sep 16 16:24:42 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:42 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518" returned: 0 in 0.468s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0603b0de-44c4-4795-a220-4512b77515bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f9bac4-6514-498c-b0b5-950f8c6d99fa]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:43 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd Sep 16 16:24:43 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:43 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd" returned: 0 in 0.405s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:43 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 Sep 16 16:24:43 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:43 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518" returned: 0 in 0.353s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:43 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518 Sep 16 16:24:43 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:44 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.6443f807-a15c-4b19-870a-9e009b5f9518" returned: 0 in 0.329s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0603b0de-44c4-4795-a220-4512b77515bd /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 -F qcow2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:44 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0603b0de-44c4-4795-a220-4512b77515bd /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 -F qcow2 Sep 16 16:24:44 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:44 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0603b0de-44c4-4795-a220-4512b77515bd /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 -F qcow2" returned: 0 in 0.325s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-6443f807-a15c-4b19-870a-9e009b5f9518" released by "_delete_snapshot" :: held 3.460s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-0603b0de-44c4-4795-a220-4512b77515bd" released by "delete_snapshot" :: held 3.489s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Created reservations ['279d1a65-d1ba-481a-a901-3a6359f9572f', 'f23c45d3-e267-453c-b96f-a517b3c634c2', 'b95ffb1e-ab88-4bcd-bbf4-f49de393aa54', '0ce3a965-1a4f-4ac7-9589-3da823743547'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:24:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Delete snapshot completed successfully. Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-6443f807-a15c-4b19-870a-9e009b5f9518-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-f700d548-a916-4b1e-9523-7a5630e16e75-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-f700d548-a916-4b1e-9523-7a5630e16e75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-0603b0de-44c4-4795-a220-4512b77515bd" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-0603b0de-44c4-4795-a220-4512b77515bd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-f700d548-a916-4b1e-9523-7a5630e16e75" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-f700d548-a916-4b1e-9523-7a5630e16e75" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Deleting offline snapshot f700d548-a916-4b1e-9523-7a5630e16e75 of volume 0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] snapshot_file for this snap is: volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd60b77-2ca2-438c-b480-e26b8143fd4c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:44 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 Sep 16 16:24:44 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:45 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75" returned: 0 in 0.404s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0603b0de-44c4-4795-a220-4512b77515bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:24:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[227ce500-8de0-4c71-88a7-c53384b7adea]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:45 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd Sep 16 16:24:45 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:45 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd" returned: 0 in 0.391s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:45 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 Sep 16 16:24:45 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:45 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75" returned: 0 in 0.428s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:45 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75 Sep 16 16:24:45 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:46 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd.f700d548-a916-4b1e-9523-7a5630e16e75" returned: 0 in 0.299s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-f700d548-a916-4b1e-9523-7a5630e16e75" released by "_delete_snapshot" :: held 1.664s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-0603b0de-44c4-4795-a220-4512b77515bd" released by "delete_snapshot" :: held 1.690s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Created reservations ['98a608a7-2fa8-46d6-8e4e-d453b7c523e9', '0ab13179-fdfc-4907-817e-cf6c12391161', '3e5623da-edbd-459e-8d37-1477b02725cd', 'e0cf2e22-ba6d-40c6-8381-a187e1ef2ae3'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:24:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Delete snapshot completed successfully. Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-f700d548-a916-4b1e-9523-7a5630e16e75-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Snapshots deleted, issuing volume delete {{(pid=86255) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-0603b0de-44c4-4795-a220-4512b77515bd" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-0603b0de-44c4-4795-a220-4512b77515bd" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[49892afe-827d-437b-906d-e0bb96aab259]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:46 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd Sep 16 16:24:46 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:46 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd" returned: 0 in 0.403s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:46 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd Sep 16 16:24:46 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:47 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0603b0de-44c4-4795-a220-4512b77515bd" returned: 0 in 0.263s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-0603b0de-44c4-4795-a220-4512b77515bd" released by "delete_volume" :: held 0.758s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Created reservations ['3f6af60a-d596-4f48-8edd-043db71b687a', 'bf4f40be-68f6-4667-b90b-ef7e29afb710', '776ab677-111c-42da-86d6-3ada993acb14', 'a789486b-d0ba-4926-bcde-5d5acf30f991'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:47 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:24:47 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:47 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.256s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:24:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Deleted volume successfully. Sep 16 16:24:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f700473d-8995-4f8c-936e-860d6bea267a tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-0603b0de-44c4-4795-a220-4512b77515bd-delete_volume" released by "delete_volume" :: held 6.869s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Flow 'volume_create_manager' (c814b81d-ebdb-4df5-aa4e-31c1c372c354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79473f05-bb02-4fb7-86e1-f7f0ef5b310d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79473f05-bb02-4fb7-86e1-f7f0ef5b310d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-88014567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f0a9a2-0519-4ad6-8bef-ca316dcad6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392765b1d02c48b58e13a70acfaa1ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:49Z,use_quota=True,user_id='b5cb9b2df95048678f2e6aeb091caa28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2c475e-439d-48f5-8b5f-17ed67e337e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2c475e-439d-48f5-8b5f-17ed67e337e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e11585c-08e4-4dd1-8b9b-fc40832473da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e11585c-08e4-4dd1-8b9b-fc40832473da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f0a9a2-0519-4ad6-8bef-ca316dcad6af', 'volume_name': 'volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b801ab1-d8bf-4b31-b073-01ea7a68c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b801ab1-d8bf-4b31-b073-01ea7a68c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aafe3d9-65c1-46ab-8a6d-eb5e6f48513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:49 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Volume 19f0a9a2-0519-4ad6-8bef-ca316dcad6af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af', 'volume_size': 1} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-88014567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f0a9a2-0519-4ad6-8bef-ca316dcad6af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392765b1d02c48b58e13a70acfaa1ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:49Z,use_quota=True,user_id='b5cb9b2df95048678f2e6aeb091caa28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Creating volume 19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:24:49 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:49 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af 1073741824 Sep 16 16:24:49 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:49 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af 1073741824" returned: 0 in 0.522s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:50 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af Sep 16 16:24:50 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:50 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:24:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aafe3d9-65c1-46ab-8a6d-eb5e6f48513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c83ad1-9949-40dd-9f9e-f1eba3fc7542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:50 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Volume volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af (19f0a9a2-0519-4ad6-8bef-ca316dcad6af): created successfully Sep 16 16:24:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c83ad1-9949-40dd-9f9e-f1eba3fc7542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Flow 'volume_create_manager' (c814b81d-ebdb-4df5-aa4e-31c1c372c354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:24:50 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3249e82a-8731-437a-a798-d436d4826f95 tempest-VolumesDeleteCascade-324032045 None] Created volume successfully. Sep 16 16:24:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Creating offline snapshot fd848b50-ec28-44e0-bbe0-26097c79a23d of volume 19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:24:51 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c11146-c8b8-4af4-887f-320de09b4c80]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:51 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af Sep 16 16:24:51 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:52 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" returned: 0 in 0.392s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:52 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d 1G Sep 16 16:24:52 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:52 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d 1G" returned: 0 in 0.599s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:52 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d Sep 16 16:24:52 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:52 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d" returned: 0 in 0.315s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:52 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d is being set with open permissions: ugo+rw Sep 16 16:24:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:53 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d Sep 16 16:24:53 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:53 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d" returned: 0 in 0.283s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:53 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.info Sep 16 16:24:53 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:53 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.info" returned: 0 in 0.277s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:53 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.info is being set with open permissions: ugo+rw Sep 16 16:24:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:53 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.info Sep 16 16:24:53 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:53 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.info" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.267s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:53 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-81ab795e-fb89-45a0-b8d8-69f32ba5ea79 tempest-VolumesDeleteCascade-324032045 None] Create snapshot completed successfully Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Flow 'volume_create_manager' (173b116a-49a5-49ad-8e6a-8cf0b6b22abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144095ed-b6ea-4903-b641-bd663e23c945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144095ed-b6ea-4903-b641-bd663e23c945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-760838285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42795d2-7aa8-41ff-bc97-307bfc4d6e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='392765b1d02c48b58e13a70acfaa1ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fd848b50-ec28-44e0-bbe0-26097c79a23d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:24:55Z,use_quota=True,user_id='b5cb9b2df95048678f2e6aeb091caa28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7396496f-ecd6-4bbf-98d4-81a48fd6ad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7396496f-ecd6-4bbf-98d4-81a48fd6ad8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaf55be-104c-4c96-aa90-9ad6e7f931e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbaf55be-104c-4c96-aa90-9ad6e7f931e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd42795d2-7aa8-41ff-bc97-307bfc4d6e18', 'volume_name': 'volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18', 'volume_size': 1, 'snapshot_id': 'fd848b50-ec28-44e0-bbe0-26097c79a23d'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c93a75d-8fb7-4cf2-9d2c-e7eca18174e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c93a75d-8fb7-4cf2-9d2c-e7eca18174e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713a4c48-77e1-499b-b0f3-9cd85d70afa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:24:55 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Volume d42795d2-7aa8-41ff-bc97-307bfc4d6e18: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18', 'volume_size': 1, 'snapshot_id': 'fd848b50-ec28-44e0-bbe0-26097c79a23d'} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-fd848b50-ec28-44e0-bbe0-26097c79a23d-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" by "_create_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-fd848b50-ec28-44e0-bbe0-26097c79a23d-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Creating volume d42795d2-7aa8-41ff-bc97-307bfc4d6e18 from snapshot fd848b50-ec28-44e0-bbe0-26097c79a23d {{(pid=86255) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] snapshot: fd848b50-ec28-44e0-bbe0-26097c79a23d, volume: d42795d2-7aa8-41ff-bc97-307bfc4d6e18, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0113af-e761-4e00-845e-7aa6cc9f09ef]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:55 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d Sep 16 16:24:55 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:56 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d" returned: 0 in 0.569s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:24:56 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7cc5ac-248e-410b-b0cd-8318db3ed010]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:24:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:56 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af Sep 16 16:24:56 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:24:56 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 16 16:24:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:24:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:24:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:24:56 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:24:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:24:56 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 Sep 16 16:24:56 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:04 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" returned: 0 in 7.622s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af, size 1024.00 MB, duration 7.62 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:25:04 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Converted 1024.00 MB image at 134.32 MB/s Sep 16 16:25:04 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 is being set with open permissions: ugo+rw Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:04 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 Sep 16 16:25:04 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:04 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" returned: 0 in 0.260s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" released by "_copy_volume_from_snapshot" :: held 9.018s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-fd848b50-ec28-44e0-bbe0-26097c79a23d-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" released by "_create_volume_from_snapshot" :: held 9.087s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.105s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713a4c48-77e1-499b-b0f3-9cd85d70afa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18', 'volume_size': 1, 'snapshot_id': 'fd848b50-ec28-44e0-bbe0-26097c79a23d'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6530b47e-34d1-4263-9bac-328ce7e09cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:04 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Volume volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 (d42795d2-7aa8-41ff-bc97-307bfc4d6e18): created successfully Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6530b47e-34d1-4263-9bac-328ce7e09cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Flow 'volume_create_manager' (173b116a-49a5-49ad-8e6a-8cf0b6b22abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:04 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2810c6fa-730d-4c0e-b18c-f0929421a0bf tempest-VolumesDeleteCascade-324032045 None] Created volume successfully. Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-19f0a9a2-0519-4ad6-8bef-ca316dcad6af-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-19f0a9a2-0519-4ad6-8bef-ca316dcad6af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Performing cascade delete. {{(pid=86255) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-fd848b50-ec28-44e0-bbe0-26097c79a23d-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-fd848b50-ec28-44e0-bbe0-26097c79a23d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-fd848b50-ec28-44e0-bbe0-26097c79a23d" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-fd848b50-ec28-44e0-bbe0-26097c79a23d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Deleting offline snapshot fd848b50-ec28-44e0-bbe0-26097c79a23d of volume 19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] snapshot_file for this snap is: volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[42711819-de01-4720-882b-7889aad1cdac]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:25:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:05 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d Sep 16 16:25:05 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:06 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d" returned: 0 in 0.445s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:25:06 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d1ca4a-5f1f-4c11-9eb2-ab52838bf795]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:25:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:06 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af Sep 16 16:25:06 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:07 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" returned: 0 in 0.796s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:07 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d Sep 16 16:25:07 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:07 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d" returned: 0 in 0.546s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:07 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d Sep 16 16:25:07 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:08 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af.fd848b50-ec28-44e0-bbe0-26097c79a23d" returned: 0 in 0.365s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-fd848b50-ec28-44e0-bbe0-26097c79a23d" released by "_delete_snapshot" :: held 2.303s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" released by "delete_snapshot" :: held 2.342s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Created reservations ['b64e040a-4871-45dd-bb64-ee6033cb9988', 'b4be5875-78bc-46d4-b75e-6b6837f6c5ac', 'a11c06b1-cff0-4ca8-bd22-88d06915219c', 'd7234dd1-fdc7-468e-a71a-357236be202d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:25:08 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Delete snapshot completed successfully. Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-fd848b50-ec28-44e0-bbe0-26097c79a23d-delete_snapshot" released by "delete_snapshot" :: held 2.595s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Snapshots deleted, issuing volume delete {{(pid=86255) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f485e07-48ff-4ce8-abd0-c83faf3b98d8]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:08 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af Sep 16 16:25:08 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:08 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" returned: 0 in 0.466s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:08 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af Sep 16 16:25:08 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:09 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" returned: 0 in 0.311s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-19f0a9a2-0519-4ad6-8bef-ca316dcad6af" released by "delete_volume" :: held 0.864s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Created reservations ['1e60f95b-079b-4887-b707-6894cc21c681', 'e25ab995-b398-45f9-81db-c594a293662e', 'e5cb1498-3ebe-4e59-bc4e-57d57b1c7a0e', '6578851c-4ef3-4d7d-a3c6-e633cf29d56c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:09 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:25:09 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:09 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.394s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:25:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Deleted volume successfully. Sep 16 16:25:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-327f801b-41fd-4a55-b13f-784a29b5833b tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-19f0a9a2-0519-4ad6-8bef-ca316dcad6af-delete_volume" released by "delete_volume" :: held 4.170s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-d42795d2-7aa8-41ff-bc97-307bfc4d6e18-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-d42795d2-7aa8-41ff-bc97-307bfc4d6e18-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "cinder-quobyte-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:10 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cee6b5-a529-4a54-a714-57a02f9d8d4f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:25:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:10 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 Sep 16 16:25:10 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:10 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" returned: 0 in 0.496s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:10 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18 Sep 16 16:25:10 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:11 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" returned: 0 in 0.346s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Flow 'volume_create_manager' (b84698a7-23bb-417a-b820-7df70d5990bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2a0c19-274e-4f1d-85a6-3a629f3b019f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-quobyte-d42795d2-7aa8-41ff-bc97-307bfc4d6e18" released by "delete_volume" :: held 0.969s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2a0c19-274e-4f1d-85a6-3a629f3b019f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1471638188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0d512d-bc99-4036-9dd1-7fa238b57b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf4f907497c48be90d919780a067d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:11Z,use_quota=True,user_id='9e15efacbc8747938a381352466630c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd61b15-d898-4684-aff8-6b576f37a0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd61b15-d898-4684-aff8-6b576f37a0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f27ce42-2979-44bb-ac15-96cc8118cb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f27ce42-2979-44bb-ac15-96cc8118cb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0d512d-bc99-4036-9dd1-7fa238b57b15', 'volume_name': 'volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd5ec73-7701-467f-a177-d417f5f2bf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd5ec73-7701-467f-a177-d417f5f2bf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be78dc63-cea0-429f-80f2-f043d804b6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Volume 6b0d512d-bc99-4036-9dd1-7fa238b57b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15', 'volume_size': 1} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1471638188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0d512d-bc99-4036-9dd1-7fa238b57b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf4f907497c48be90d919780a067d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:11Z,use_quota=True,user_id='9e15efacbc8747938a381352466630c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Creating volume 6b0d512d-bc99-4036-9dd1-7fa238b57b15 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:25:11 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:11 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 1073741824 Sep 16 16:25:11 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Created reservations ['745bae51-861e-4d77-83af-7f2627516719', '478923d8-70ab-422d-9599-d374e618a715', 'e6318d1b-fd5d-4f7e-8b8e-f67ec97cf54d', '9f78c0fd-a3c7-49cb-9b23-639e25f785c7'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:11 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:25:11 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Flow 'volume_create_manager' (80f9d2eb-4be4-4ea2-9666-7247e263a12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcd8e15-7ebc-41a7-a538-5cfde0e012a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdcd8e15-7ebc-41a7-a538-5cfde0e012a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-612088532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8af04e-902d-4fe4-9666-2a4b77bb3410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf4f907497c48be90d919780a067d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:12Z,use_quota=True,user_id='9e15efacbc8747938a381352466630c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db79ee9f-567b-46f5-9db9-a13de16872fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db79ee9f-567b-46f5-9db9-a13de16872fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c46b83-ed32-49de-b235-19a1fd37d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c46b83-ed32-49de-b235-19a1fd37d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8af04e-902d-4fe4-9666-2a4b77bb3410', 'volume_name': 'volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00de07d3-caad-4277-a7db-a599607b90c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00de07d3-caad-4277-a7db-a599607b90c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26633ffc-8470-4108-b848-73f99f06540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:11 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Volume 0b8af04e-902d-4fe4-9666-2a4b77bb3410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410', 'volume_size': 1} Sep 16 16:25:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:12 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.427s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:25:12 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Deleted volume successfully. Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ddfbff2e-ea56-4fee-bb63-df3dec8e27f3 tempest-VolumesDeleteCascade-324032045 None] Lock "cinder-d42795d2-7aa8-41ff-bc97-307bfc4d6e18-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:12 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 1073741824" returned: 0 in 0.768s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:12 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 Sep 16 16:25:12 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:12 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15" returned: 0 in 0.392s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-612088532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8af04e-902d-4fe4-9666-2a4b77bb3410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcf4f907497c48be90d919780a067d62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:12Z,use_quota=True,user_id='9e15efacbc8747938a381352466630c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Creating volume 0b8af04e-902d-4fe4-9666-2a4b77bb3410 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:25:12 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be78dc63-cea0-429f-80f2-f043d804b6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0302e7-f66b-4914-8a44-fed7aa604f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:12 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 1073741824 Sep 16 16:25:12 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:12 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Volume volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 (6b0d512d-bc99-4036-9dd1-7fa238b57b15): created successfully Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0302e7-f66b-4914-8a44-fed7aa604f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Flow 'volume_create_manager' (b84698a7-23bb-417a-b820-7df70d5990bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:12 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-254e666f-7ace-44e3-96d3-e92262b2fda1 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Created volume successfully. Sep 16 16:25:13 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 1073741824" returned: 0 in 0.788s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:13 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 Sep 16 16:25:13 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:13 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410" returned: 0 in 0.356s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:25:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26633ffc-8470-4108-b848-73f99f06540f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92508c43-8b7e-4e36-97c0-42222e4462fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:14 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Volume volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 (0b8af04e-902d-4fe4-9666-2a4b77bb3410): created successfully Sep 16 16:25:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92508c43-8b7e-4e36-97c0-42222e4462fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Flow 'volume_create_manager' (80f9d2eb-4be4-4ea2-9666-7247e263a12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c9b8d106-01e8-4479-9873-a50c76c23b2d tempest-TestServerVolumeAttachmentScenario-1947336598 None] Created volume successfully. Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=79,cinder:INSERT=19,cinder:UPDATE=73,cinder:DELETE=9 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=94,cinder:SELECT=69,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Flow 'volume_create_manager' (4ef13113-edfc-43eb-83eb-1ccd338912ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3b367e-7d48-4cc2-bc7b-f101f7dd2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3b367e-7d48-4cc2-bc7b-f101f7dd2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-116610472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de0610c-9ac7-4d89-8be0-9e59a8103b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40246bba25094656848e735af85b5b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:19Z,use_quota=True,user_id='96cc3bceb7924cc78dda0924adb761cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf4f407-a572-438f-af0e-faa08e1461da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf4f407-a572-438f-af0e-faa08e1461da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81579643-c632-4083-8afd-2d781ae06517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81579643-c632-4083-8afd-2d781ae06517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de0610c-9ac7-4d89-8be0-9e59a8103b3f', 'volume_name': 'volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3248d8-e2ec-4921-a075-2aafdf785891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3248d8-e2ec-4921-a075-2aafdf785891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dfd910-da3e-40ea-9d19-cd3bc0382a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:19 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Volume 4de0610c-9ac7-4d89-8be0-9e59a8103b3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f', 'volume_size': 1} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-116610472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de0610c-9ac7-4d89-8be0-9e59a8103b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40246bba25094656848e735af85b5b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:19Z,use_quota=True,user_id='96cc3bceb7924cc78dda0924adb761cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Creating volume 4de0610c-9ac7-4d89-8be0-9e59a8103b3f {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:25:19 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:25:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:19 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f 1073741824 Sep 16 16:25:19 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:20 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f 1073741824" returned: 0 in 0.718s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:20 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f Sep 16 16:25:20 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:20 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f" returned: 0 in 0.518s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:25:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:20 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5dfd910-da3e-40ea-9d19-cd3bc0382a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:20 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746dbf01-372c-4cde-adbd-bb4775d1541c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:20 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Volume volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f (4de0610c-9ac7-4d89-8be0-9e59a8103b3f): created successfully Sep 16 16:25:20 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746dbf01-372c-4cde-adbd-bb4775d1541c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:20 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Flow 'volume_create_manager' (4ef13113-edfc-43eb-83eb-1ccd338912ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:20 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-498fabfb-484e-44a6-8526-8896995ec5ee tempest-VolumesTransfersTest-162597406 None] Created volume successfully. Sep 16 16:25:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-fb3efef1-2569-485a-a9f1-07baf6802923 tempest-VolumesTransfersTest-1199017719 None] Transfer volume completed successfully. Sep 16 16:25:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Acquiring lock "cinder-4de0610c-9ac7-4d89-8be0-9e59a8103b3f-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Lock "cinder-4de0610c-9ac7-4d89-8be0-9e59a8103b3f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Acquiring lock "cinder-quobyte-4de0610c-9ac7-4d89-8be0-9e59a8103b3f" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Lock "cinder-quobyte-4de0610c-9ac7-4d89-8be0-9e59a8103b3f" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:23 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c825d-a25b-46df-9386-12c4957c6f54]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:25:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:23 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f Sep 16 16:25:23 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:23 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f" returned: 0 in 0.463s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:23 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f Sep 16 16:25:23 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:23 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4de0610c-9ac7-4d89-8be0-9e59a8103b3f" returned: 0 in 0.329s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Lock "cinder-quobyte-4de0610c-9ac7-4d89-8be0-9e59a8103b3f" released by "delete_volume" :: held 0.864s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Created reservations ['0529b987-5324-44c7-9e17-4f43670f05bb', '3693305c-ea88-41fd-b4bf-fd3dc9fc7094', '931da995-9ab2-4e0e-8c61-4ede0d478d6b', '69c4f68b-abe4-4a6f-8656-60c84212bafd'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:24 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:25:24 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:24 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.387s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:25:24 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Deleted volume successfully. Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70552736-97b5-4593-9b54-fd055ce39418 tempest-VolumesTransfersTest-1965456341 None] Lock "cinder-4de0610c-9ac7-4d89-8be0-9e59a8103b3f-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:24 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Flow 'volume_create_manager' (5ff3201e-ff13-4fe2-a9dd-1a631ecdc4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f5e409-2278-4858-9225-a1b79e020a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f5e409-2278-4858-9225-a1b79e020a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1745751341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce036a04-83cd-4025-8559-72e3d54608c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40246bba25094656848e735af85b5b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:25Z,use_quota=True,user_id='96cc3bceb7924cc78dda0924adb761cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224e2bdd-5a13-4944-a1a1-ad49d17ba4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224e2bdd-5a13-4944-a1a1-ad49d17ba4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf078c5f-0e5b-46f8-b0d5-67ac5bc701da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf078c5f-0e5b-46f8-b0d5-67ac5bc701da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce036a04-83cd-4025-8559-72e3d54608c5', 'volume_name': 'volume-ce036a04-83cd-4025-8559-72e3d54608c5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd3161d-397b-41e1-b08e-07683014f971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd3161d-397b-41e1-b08e-07683014f971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d8cec6-918a-4864-8c5e-7bbedc739e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:25 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Volume ce036a04-83cd-4025-8559-72e3d54608c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce036a04-83cd-4025-8559-72e3d54608c5', 'volume_size': 1} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1745751341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce036a04-83cd-4025-8559-72e3d54608c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40246bba25094656848e735af85b5b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:25Z,use_quota=True,user_id='96cc3bceb7924cc78dda0924adb761cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Creating volume ce036a04-83cd-4025-8559-72e3d54608c5 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:25:25 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:25 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5 1073741824 Sep 16 16:25:25 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:25 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5 1073741824" returned: 0 in 0.501s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:25 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5 Sep 16 16:25:25 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:25 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5" returned: 0 in 0.299s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d8cec6-918a-4864-8c5e-7bbedc739e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce036a04-83cd-4025-8559-72e3d54608c5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc16082-0bfc-4a34-a09c-422cda993879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:25 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Volume volume-ce036a04-83cd-4025-8559-72e3d54608c5 (ce036a04-83cd-4025-8559-72e3d54608c5): created successfully Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc16082-0bfc-4a34-a09c-422cda993879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Flow 'volume_create_manager' (5ff3201e-ff13-4fe2-a9dd-1a631ecdc4d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:26 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-73862a2e-6920-4f04-8b69-9509ebee8400 tempest-VolumesTransfersTest-162597406 None] Created volume successfully. Sep 16 16:25:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Acquiring lock "cinder-ce036a04-83cd-4025-8559-72e3d54608c5-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Lock "cinder-ce036a04-83cd-4025-8559-72e3d54608c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Acquiring lock "cinder-quobyte-ce036a04-83cd-4025-8559-72e3d54608c5" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Lock "cinder-quobyte-ce036a04-83cd-4025-8559-72e3d54608c5" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:27 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[98921d6c-7d98-4140-bb78-c98047e63cbe]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:25:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:27 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5 Sep 16 16:25:27 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:27 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5" returned: 0 in 0.439s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:28 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5 Sep 16 16:25:28 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:28 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ce036a04-83cd-4025-8559-72e3d54608c5" returned: 0 in 0.278s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Lock "cinder-quobyte-ce036a04-83cd-4025-8559-72e3d54608c5" released by "delete_volume" :: held 0.779s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Created reservations ['2aa6b0a9-d4ba-4946-9dbb-cb675a1a8308', 'b479bf7d-6974-4d6c-8aee-6c6ac1effca9', 'c3a7b479-3b82-47a2-95f4-264ad448073f', 'f42533c2-aefd-459a-8d7d-4ca04988ac14'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:28 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:25:28 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:28 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.333s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:25:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Deleted volume successfully. Sep 16 16:25:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fd8a1d1d-012f-436c-a3ac-f65759c8ab0d tempest-VolumesTransfersTest-1965456341 None] Lock "cinder-ce036a04-83cd-4025-8559-72e3d54608c5-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Flow 'volume_create_manager' (5974ac48-8dc7-42fd-8779-d5a603f6db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff1b640-e252-4bfc-b473-12eeb5f337a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff1b640-e252-4bfc-b473-12eeb5f337a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1118713723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5635241-3f93-4f18-8149-8814e5385856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e6c6abf5b34e37acf68b7a04756d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:38Z,use_quota=True,user_id='51d04fdf8075407b9383de632f638dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2c6c31-98d6-4876-8222-2627bab36c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2c6c31-98d6-4876-8222-2627bab36c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc1c7b3-a8db-4d4a-a886-7aca4bffdb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc1c7b3-a8db-4d4a-a886-7aca4bffdb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5635241-3f93-4f18-8149-8814e5385856', 'volume_name': 'volume-c5635241-3f93-4f18-8149-8814e5385856', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45771cc-40b6-4f51-ae7b-536e548d37d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45771cc-40b6-4f51-ae7b-536e548d37d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a99387c-765d-4a85-9804-277ccfc789b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Volume c5635241-3f93-4f18-8149-8814e5385856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5635241-3f93-4f18-8149-8814e5385856', 'volume_size': 1} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1118713723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5635241-3f93-4f18-8149-8814e5385856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e6c6abf5b34e37acf68b7a04756d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:38Z,use_quota=True,user_id='51d04fdf8075407b9383de632f638dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Creating volume c5635241-3f93-4f18-8149-8814e5385856 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:25:37 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:25:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:37 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856 1073741824 Sep 16 16:25:37 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:38 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856 1073741824" returned: 0 in 0.487s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:38 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856 Sep 16 16:25:38 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:38 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856" returned: 0 in 0.334s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:25:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a99387c-765d-4a85-9804-277ccfc789b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5635241-3f93-4f18-8149-8814e5385856', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cca38e-0d66-4f6c-8c56-2a85cc55a4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:38 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Volume volume-c5635241-3f93-4f18-8149-8814e5385856 (c5635241-3f93-4f18-8149-8814e5385856): created successfully Sep 16 16:25:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cca38e-0d66-4f6c-8c56-2a85cc55a4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Flow 'volume_create_manager' (5974ac48-8dc7-42fd-8779-d5a603f6db3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4544af46-d074-43ae-8375-89fedb2477e2 tempest-VolumesTransfersV355Test-236913449 None] Created volume successfully. Sep 16 16:25:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c6cc5bb1-052f-406f-8f56-2cf1f7325472 tempest-VolumesTransfersV355Test-1098300802 None] Transfer volume completed successfully. Sep 16 16:25:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Acquiring lock "cinder-c5635241-3f93-4f18-8149-8814e5385856-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Lock "cinder-c5635241-3f93-4f18-8149-8814e5385856-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Acquiring lock "cinder-quobyte-c5635241-3f93-4f18-8149-8814e5385856" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Lock "cinder-quobyte-c5635241-3f93-4f18-8149-8814e5385856" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19a41b0-f0ba-4852-9771-d37a245c1421]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:41 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856 Sep 16 16:25:41 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:41 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856" returned: 0 in 0.369s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:41 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856 Sep 16 16:25:41 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:41 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c5635241-3f93-4f18-8149-8814e5385856" returned: 0 in 0.260s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Lock "cinder-quobyte-c5635241-3f93-4f18-8149-8814e5385856" released by "delete_volume" :: held 0.672s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Created reservations ['7d80080c-f084-4f7a-92fe-ac4671d63b41', '2cbd146f-c3da-4bca-91ed-a43edb2f2938', 'deb1edaa-a91f-4bb9-8d84-8620209b9f95', '23de9932-c0b1-46f9-bd4c-549d1832dbcf'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:25:41 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:25:41 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:41 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:25:41 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:42 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:25:42 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.294s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:25:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Deleted volume successfully. Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d7776815-f684-4561-827a-3909a67d5f21 tempest-VolumesTransfersV355Test-1147487873 None] Lock "cinder-c5635241-3f93-4f18-8149-8814e5385856-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Flow 'volume_create_manager' (48236053-924d-404a-bfb0-2298592d875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a68e74-da9f-424c-9a7a-232f3fc13880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53a68e74-da9f-424c-9a7a-232f3fc13880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-468612709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58144b89-8976-47c3-8b78-bebea4380730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e6c6abf5b34e37acf68b7a04756d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:43Z,use_quota=True,user_id='51d04fdf8075407b9383de632f638dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ceef7dc-1d06-4d50-8fcd-b8ebda0d5b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ceef7dc-1d06-4d50-8fcd-b8ebda0d5b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1cf49e-0fcd-412f-9020-8307980049c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1cf49e-0fcd-412f-9020-8307980049c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58144b89-8976-47c3-8b78-bebea4380730', 'volume_name': 'volume-58144b89-8976-47c3-8b78-bebea4380730', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d3d7fe-4099-4d6c-993a-cca694dbfecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40d3d7fe-4099-4d6c-993a-cca694dbfecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c5e1e3-968d-46bd-9d6e-315681f20801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:42 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Volume 58144b89-8976-47c3-8b78-bebea4380730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58144b89-8976-47c3-8b78-bebea4380730', 'volume_size': 1} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-468612709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58144b89-8976-47c3-8b78-bebea4380730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e6c6abf5b34e37acf68b7a04756d65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:43Z,use_quota=True,user_id='51d04fdf8075407b9383de632f638dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Creating volume 58144b89-8976-47c3-8b78-bebea4380730 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:25:42 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:25:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:42 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730 1073741824 Sep 16 16:25:42 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:43 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730 1073741824" returned: 0 in 0.554s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:43 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730 Sep 16 16:25:43 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:43 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730" returned: 0 in 0.280s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:25:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c5e1e3-968d-46bd-9d6e-315681f20801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58144b89-8976-47c3-8b78-bebea4380730', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8e4436-6382-410f-96bb-8f8088a75175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:43 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Volume volume-58144b89-8976-47c3-8b78-bebea4380730 (58144b89-8976-47c3-8b78-bebea4380730): created successfully Sep 16 16:25:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8e4436-6382-410f-96bb-8f8088a75175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Flow 'volume_create_manager' (48236053-924d-404a-bfb0-2298592d875e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9431f8f8-eaab-494a-9c59-e42121446c5d tempest-VolumesTransfersV355Test-236913449 None] Created volume successfully. Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Acquiring lock "cinder-58144b89-8976-47c3-8b78-bebea4380730-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Lock "cinder-58144b89-8976-47c3-8b78-bebea4380730-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Acquiring lock "cinder-quobyte-58144b89-8976-47c3-8b78-bebea4380730" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Lock "cinder-quobyte-58144b89-8976-47c3-8b78-bebea4380730" acquired by "delete_volume" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f1a19-a79a-4b35-a079-cf63949b2f77]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:45 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730 Sep 16 16:25:45 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:45 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730" returned: 0 in 0.394s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:45 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730 Sep 16 16:25:45 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:45 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-58144b89-8976-47c3-8b78-bebea4380730" returned: 0 in 0.300s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Lock "cinder-quobyte-58144b89-8976-47c3-8b78-bebea4380730" released by "delete_volume" :: held 0.740s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:45 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Created reservations ['e63a2e2d-a657-46f2-a2cd-9f2e40c10dc8', 'd04808f8-eae8-4e49-8b1f-447b221022d5', 'cfdc2c16-dd23-4187-ada2-99a166899d17', '916f4627-870b-4dc9-ab15-7dfc3b5d21db'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:25:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:46 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:25:46 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:46 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.293s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:46 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:25:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Deleted volume successfully. Sep 16 16:25:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-837940d8-756d-4221-b161-23e73d394d09 tempest-VolumesTransfersV355Test-1147487873 None] Lock "cinder-58144b89-8976-47c3-8b78-bebea4380730-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-5b85665e-7a8b-4e28-a49a-cf0d80c3da11 req-b6de44c5-7e7e-48e3-8a57-17ecd6f80544 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-5b85665e-7a8b-4e28-a49a-cf0d80c3da11 req-b6de44c5-7e7e-48e3-8a57-17ecd6f80544 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-5b85665e-7a8b-4e28-a49a-cf0d80c3da11 req-b6de44c5-7e7e-48e3-8a57-17ecd6f80544 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:47 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-5b85665e-7a8b-4e28-a49a-cf0d80c3da11 req-b6de44c5-7e7e-48e3-8a57-17ecd6f80544 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6072d8c8-3b2b-4d3e-ba80-af59ef60e205', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:25:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-5b85665e-7a8b-4e28-a49a-cf0d80c3da11 req-b6de44c5-7e7e-48e3-8a57-17ecd6f80544 tempest-TestServerVolumeAttachmentScenario-1947336598 None] attachment_update completed successfully. Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Flow 'volume_create_manager' (2f9879b3-4362-417c-99d1-60e4504673bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac3b495-3d7a-4b12-8bd4-93222579e270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac3b495-3d7a-4b12-8bd4-93222579e270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1797576028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a85977-7d90-408d-a1aa-8bb31c73c3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e54ee548a1a41b8853d903191aa5024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:53Z,use_quota=True,user_id='351ecfac72144732aaed357dea20c12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e70c3-d2f0-4dac-a3e5-3ac22e47f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d57e70c3-d2f0-4dac-a3e5-3ac22e47f653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2629c6b-14b3-4db7-8383-d22c8fd61f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2629c6b-14b3-4db7-8383-d22c8fd61f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a85977-7d90-408d-a1aa-8bb31c73c3e1', 'volume_name': 'volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1', 'volume_size': 2}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e378f70-9c21-40f8-919b-0cd498cf4c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e378f70-9c21-40f8-919b-0cd498cf4c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a53468-90d6-4ef0-be65-d6b070dbacbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Volume 67a85977-7d90-408d-a1aa-8bb31c73c3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1', 'volume_size': 2} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1797576028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a85977-7d90-408d-a1aa-8bb31c73c3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e54ee548a1a41b8853d903191aa5024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:25:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:25:53Z,use_quota=True,user_id='351ecfac72144732aaed357dea20c12f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Creating volume 67a85977-7d90-408d-a1aa-8bb31c73c3e1 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:25:53 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 2147483648 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:53 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 2147483648 Sep 16 16:25:53 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e52ef115-b77a-42a8-96fb-b8c9abf71d0a req-d1183715-f62e-4c47-93c2-282af50b20c0 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:53 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 2147483648" returned: 0 in 0.616s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:53 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 Sep 16 16:25:53 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:54 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e52ef115-b77a-42a8-96fb-b8c9abf71d0a req-d1183715-f62e-4c47-93c2-282af50b20c0 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.548s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a53468-90d6-4ef0-be65-d6b070dbacbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1', 'volume_size': 2}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b9be27-888c-45b4-b1a6-1f3cccc4824e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [req-e52ef115-b77a-42a8-96fb-b8c9abf71d0a req-d1183715-f62e-4c47-93c2-282af50b20c0 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:54 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Volume volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 (67a85977-7d90-408d-a1aa-8bb31c73c3e1): created successfully Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b9be27-888c-45b4-b1a6-1f3cccc4824e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Flow 'volume_create_manager' (2f9879b3-4362-417c-99d1-60e4504673bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:25:54 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ed4c8e5c-0581-4a59-82c3-b2aa2022295e tempest-VolumesCloneNegativeTest-1878692021 None] Created volume successfully. Sep 16 16:25:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-e52ef115-b77a-42a8-96fb-b8c9abf71d0a req-d1183715-f62e-4c47-93c2-282af50b20c0 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef', 'name': 'volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '608ae702-48b9-4fb9-9826-01f1db047f72', 'enforce_multipath': True} {{(pid=86255) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 16 16:25:54 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-e52ef115-b77a-42a8-96fb-b8c9abf71d0a req-d1183715-f62e-4c47-93c2-282af50b20c0 tempest-TestServerVolumeAttachmentScenario-1947336598 None] attachment_update completed successfully. Sep 16 16:25:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Acquiring lock "cinder-67a85977-7d90-408d-a1aa-8bb31c73c3e1-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Lock "cinder-67a85977-7d90-408d-a1aa-8bb31c73c3e1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Acquiring lock "cinder-quobyte-67a85977-7d90-408d-a1aa-8bb31c73c3e1" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:25:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Lock "cinder-quobyte-67a85977-7d90-408d-a1aa-8bb31c73c3e1" acquired by "delete_volume" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:25:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1e51a7-da87-4783-a062-71b9722c6f3a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:25:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:55 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 Sep 16 16:25:55 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:55 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1" returned: 0 in 0.439s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:55 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1 Sep 16 16:25:55 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:56 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-67a85977-7d90-408d-a1aa-8bb31c73c3e1" returned: 0 in 0.263s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Lock "cinder-quobyte-67a85977-7d90-408d-a1aa-8bb31c73c3e1" released by "delete_volume" :: held 0.755s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Created reservations ['b2e41308-c044-4387-8f1c-b85e5a324a85', 'e5e545f0-5e10-4104-a1e0-1db9627d6e90', 'cef96f29-5f3f-4d1f-81a0-7742c782b382', 'd273a66b-5a5f-4c76-b885-0431f34d8fb2'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:25:56 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-716fce9f-920b-4601-ae97-a9fc4b94a3a1 req-7738464b-9265-44de-a776-12e3a569b426 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Terminate volume connection completed successfully. Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-716fce9f-920b-4601-ae97-a9fc4b94a3a1 req-7738464b-9265-44de-a776-12e3a569b426 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Deleting attachment 608ae702-48b9-4fb9-9826-01f1db047f72. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:25:56 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:25:56 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:25:56 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.284s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:25:56 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Deleted volume successfully. Sep 16 16:25:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-21080acd-8776-4f9e-b112-128cabdce839 tempest-VolumesCloneNegativeTest-1878692021 None] Lock "cinder-67a85977-7d90-408d-a1aa-8bb31c73c3e1-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:25:57 devstack cinder-volume[86255]: INFO cinder.volume.manager [req-4c974dc9-65ab-462f-9216-6633349becee req-21707251-ba43-40e7-a0da-fedc587597dd tempest-TestServerVolumeAttachmentScenario-1947336598 None] Terminate volume connection completed successfully. Sep 16 16:25:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [req-4c974dc9-65ab-462f-9216-6633349becee req-21707251-ba43-40e7-a0da-fedc587597dd tempest-TestServerVolumeAttachmentScenario-1947336598 None] Deleting attachment 6072d8c8-3b2b-4d3e-ba80-af59ef60e205. {{(pid=86255) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (07c06a27-ee5e-4ecd-a29d-1e15d1cdca8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3c24cb-fd51-4c79-a28e-b29f8378f00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3c24cb-fd51-4c79-a28e-b29f8378f00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-494387506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9a4d78-41ff-48a4-aa52-1e43038d41b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:01Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1d2874-a772-408d-94da-e7284f11c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1d2874-a772-408d-94da-e7284f11c755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6351e115-12ae-4ecf-9621-5e772fcf99ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6351e115-12ae-4ecf-9621-5e772fcf99ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9a4d78-41ff-48a4-aa52-1e43038d41b3', 'volume_name': 'volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dffb69c-6e33-4951-80e0-bf5968d03ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dffb69c-6e33-4951-80e0-bf5968d03ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215f4a40-6645-47a6-8d1e-f03da2f029bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:01 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Volume 9b9a4d78-41ff-48a4-aa52-1e43038d41b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3', 'volume_size': 1} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-494387506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9a4d78-41ff-48a4-aa52-1e43038d41b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:01Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Creating volume 9b9a4d78-41ff-48a4-aa52-1e43038d41b3 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:26:01 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:01 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 1073741824 Sep 16 16:26:01 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:01 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 1073741824" returned: 0 in 0.577s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:01 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 Sep 16 16:26:01 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:02 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3" returned: 0 in 0.286s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215f4a40-6645-47a6-8d1e-f03da2f029bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca2f2e7-c3bd-41ce-abe9-293bd90dca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:02 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Volume volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 (9b9a4d78-41ff-48a4-aa52-1e43038d41b3): created successfully Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca2f2e7-c3bd-41ce-abe9-293bd90dca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (07c06a27-ee5e-4ecd-a29d-1e15d1cdca8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:02 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-42052eab-edbd-4469-ad28-f9c689eee2be tempest-VolumesGetTest-1629182632 None] Created volume successfully. Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "cinder-0b8af04e-902d-4fe4-9666-2a4b77bb3410-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "cinder-0b8af04e-902d-4fe4-9666-2a4b77bb3410-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "cinder-quobyte-0b8af04e-902d-4fe4-9666-2a4b77bb3410" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "cinder-quobyte-0b8af04e-902d-4fe4-9666-2a4b77bb3410" acquired by "delete_volume" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4e13ad-a2b9-4e26-ab4f-2d115c6bca49]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:02 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 Sep 16 16:26:02 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:03 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410" returned: 0 in 0.449s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:03 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410 Sep 16 16:26:03 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:03 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0b8af04e-902d-4fe4-9666-2a4b77bb3410" returned: 0 in 0.339s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "cinder-quobyte-0b8af04e-902d-4fe4-9666-2a4b77bb3410" released by "delete_volume" :: held 0.858s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Created reservations ['879611d4-a25e-47c6-a44c-3548655f3714', '8fcaa6bc-8909-498d-a4c5-5a8c69c1d00d', 'e4a7b11d-a13b-4dc8-ae07-5826841766a3', '817377fe-424a-43b2-b17d-11c945f128ca'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:03 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:03 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "cinder-6b0d512d-bc99-4036-9dd1-7fa238b57b15-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "cinder-6b0d512d-bc99-4036-9dd1-7fa238b57b15-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "cinder-quobyte-6b0d512d-bc99-4036-9dd1-7fa238b57b15" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "cinder-quobyte-6b0d512d-bc99-4036-9dd1-7fa238b57b15" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac1edfc-fc28-4130-a2c5-293f39eea577]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:04 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.425s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:04 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Deleted volume successfully. Sep 16 16:26:04 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 Sep 16 16:26:04 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-487ddf85-88e0-4dc3-a833-c56f1c2fb369 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "cinder-0b8af04e-902d-4fe4-9666-2a4b77bb3410-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (fa961e87-5d54-40e7-8bd4-766c342f8f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dab741e-36ee-4e55-b1ad-abaa4417265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dab741e-36ee-4e55-b1ad-abaa4417265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1177498539',display_name='tempest-VolumesGetTest-Volume-316828697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3deb91e-444d-4d1c-ad90-307cfa392fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:04Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49b5484-e606-465e-a5bb-553c2b74d87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:04 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49b5484-e606-465e-a5bb-553c2b74d87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da41acf9-09c9-4095-b527-232414d751e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da41acf9-09c9-4095-b527-232414d751e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3deb91e-444d-4d1c-ad90-307cfa392fc7', 'volume_name': 'volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0c485d-13c0-4fc8-9c19-0ab1a512ee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0c485d-13c0-4fc8-9c19-0ab1a512ee80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5418fb34-4840-4979-b9ac-edbba82d7263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:04 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Volume b3deb91e-444d-4d1c-ad90-307cfa392fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7', 'volume_size': 1} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1177498539',display_name='tempest-VolumesGetTest-Volume-316828697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3deb91e-444d-4d1c-ad90-307cfa392fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:04Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Creating volume b3deb91e-444d-4d1c-ad90-307cfa392fc7 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:26:04 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15" returned: 0 in 0.451s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:04 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 1073741824 Sep 16 16:26:04 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:04 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15 Sep 16 16:26:04 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:04 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6b0d512d-bc99-4036-9dd1-7fa238b57b15" returned: 0 in 0.261s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "cinder-quobyte-6b0d512d-bc99-4036-9dd1-7fa238b57b15" released by "delete_volume" :: held 0.781s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Created reservations ['dab4b36b-7b8f-4128-ab12-bc41d063debe', '7df8f53f-5257-4903-b70d-6d244e966544', 'd5bb9396-59b4-4ad6-a651-05830d608b70', 'c061847f-2f8b-467e-a27e-a1d98a912abd'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:05 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:05 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:05 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 1073741824" returned: 0 in 0.509s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:05 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 Sep 16 16:26:05 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:05 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.308s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Deleted volume successfully. Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-58991940-11da-48c6-9bc0-49cd0efa9404 tempest-TestServerVolumeAttachmentScenario-1947336598 None] Lock "cinder-6b0d512d-bc99-4036-9dd1-7fa238b57b15-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:05 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7" returned: 0 in 0.284s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5418fb34-4840-4979-b9ac-edbba82d7263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5551049e-3df3-4b77-a523-34fc81db1fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:05 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Volume volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 (b3deb91e-444d-4d1c-ad90-307cfa392fc7): created successfully Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5551049e-3df3-4b77-a523-34fc81db1fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:05 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (fa961e87-5d54-40e7-8bd4-766c342f8f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c7098454-3c82-4456-8912-0eb2ff99b279 tempest-VolumesGetTest-1629182632 None] Created volume successfully. Sep 16 16:26:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-b3deb91e-444d-4d1c-ad90-307cfa392fc7-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Lock "cinder-b3deb91e-444d-4d1c-ad90-307cfa392fc7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-quobyte-b3deb91e-444d-4d1c-ad90-307cfa392fc7" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-b3deb91e-444d-4d1c-ad90-307cfa392fc7" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:06 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7f2045-7226-45ff-bd82-68be511cf7da]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:06 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 Sep 16 16:26:06 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:07 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7" returned: 0 in 0.378s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:07 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7 Sep 16 16:26:07 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:07 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b3deb91e-444d-4d1c-ad90-307cfa392fc7" returned: 0 in 0.276s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-b3deb91e-444d-4d1c-ad90-307cfa392fc7" released by "delete_volume" :: held 0.701s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Created reservations ['24dea5c7-d8cd-4d18-adba-c6e9dd9bb6e9', '611d3668-dc4b-454f-86b9-3922b1bbe6de', 'b74ef06a-5361-4ad2-b838-689927f188a2', 'e0a0737e-b37f-4bd5-805e-390423826f1b'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:07 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:07 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:07 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.310s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Deleted volume successfully. Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-5786c462-9f3e-420a-9679-46fa7a733e53 tempest-VolumesGetTest-1629182632 None] Lock "cinder-b3deb91e-444d-4d1c-ad90-307cfa392fc7-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-9b9a4d78-41ff-48a4-aa52-1e43038d41b3-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Lock "cinder-9b9a4d78-41ff-48a4-aa52-1e43038d41b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-quobyte-9b9a4d78-41ff-48a4-aa52-1e43038d41b3" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-9b9a4d78-41ff-48a4-aa52-1e43038d41b3" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54d6aa5-f7b1-451b-86b6-393f5004924f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:08 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 Sep 16 16:26:08 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:08 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3" returned: 0 in 0.344s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:08 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3 Sep 16 16:26:08 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:08 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9b9a4d78-41ff-48a4-aa52-1e43038d41b3" returned: 0 in 0.255s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-9b9a4d78-41ff-48a4-aa52-1e43038d41b3" released by "delete_volume" :: held 0.641s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Created reservations ['2b3862ae-9cce-4ddc-a377-93e65f88dc55', '2af6de9d-1d42-4193-8e0b-51b85926267a', '86069fac-a0ab-4034-8504-2ea0460536bb', '31289f1f-c13c-4352-b460-8534ec1befe4'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:08 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:08 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:09 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.337s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Deleted volume successfully. Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f4c7b7d7-fe80-4a23-952f-10c60e97cca1 tempest-VolumesGetTest-1629182632 None] Lock "cinder-9b9a4d78-41ff-48a4-aa52-1e43038d41b3-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (104d8c7a-f1c2-4593-9633-ec58c389ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40fdc10b-101b-40e1-8c49-cf10bb2655eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40fdc10b-101b-40e1-8c49-cf10bb2655eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-179615993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cee2ff-316c-4817-b1d5-554d8c62792f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:10Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01e2266-f928-458c-aff2-a50878824dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01e2266-f928-458c-aff2-a50878824dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2429334-e850-4115-bb04-10a48f9e3110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2429334-e850-4115-bb04-10a48f9e3110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83cee2ff-316c-4817-b1d5-554d8c62792f', 'volume_name': 'volume-83cee2ff-316c-4817-b1d5-554d8c62792f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db58c79-2ab6-49f1-a0d2-530b50c7ecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db58c79-2ab6-49f1-a0d2-530b50c7ecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0cff4d-9f88-4b2a-80ec-a043ae4e972f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Volume 83cee2ff-316c-4817-b1d5-554d8c62792f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83cee2ff-316c-4817-b1d5-554d8c62792f', 'volume_size': 1} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-179615993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cee2ff-316c-4817-b1d5-554d8c62792f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:10Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Creating volume 83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:26:09 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:26:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:09 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f 1073741824 Sep 16 16:26:09 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:10 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f 1073741824" returned: 0 in 0.530s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:10 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f Sep 16 16:26:10 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:10 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f" returned: 0 in 0.270s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:10 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:26:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0cff4d-9f88-4b2a-80ec-a043ae4e972f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83cee2ff-316c-4817-b1d5-554d8c62792f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5aad04b-36c5-492d-a846-43693f71cc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:10 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Volume volume-83cee2ff-316c-4817-b1d5-554d8c62792f (83cee2ff-316c-4817-b1d5-554d8c62792f): created successfully Sep 16 16:26:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5aad04b-36c5-492d-a846-43693f71cc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:10 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (104d8c7a-f1c2-4593-9633-ec58c389ec76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:10 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0ef8bed9-02f2-4af6-837d-066383920f60 tempest-VolumesGetTest-1629182632 None] Created volume successfully. Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (905d014e-f457-4ffe-9061-fa9f32c01963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf1d861-fc08-4366-b8d2-9ee997fbc973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf1d861-fc08-4366-b8d2-9ee997fbc973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1904474637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12090146-8443-42d9-9ad2-d22725bd58a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=83cee2ff-316c-4817-b1d5-554d8c62792f,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:12Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbf2580-a4ab-4ab1-9da1-6b495e27d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bbf2580-a4ab-4ab1-9da1-6b495e27d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6c9616-3703-4d87-9337-780d38bbcadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6c9616-3703-4d87-9337-780d38bbcadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '12090146-8443-42d9-9ad2-d22725bd58a4', 'volume_name': 'volume-12090146-8443-42d9-9ad2-d22725bd58a4', 'volume_size': 1, 'source_volid': '83cee2ff-316c-4817-b1d5-554d8c62792f', 'source_volstatus': 'available'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce169288-64ae-45df-871d-7788558323bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce169288-64ae-45df-871d-7788558323bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2474a3f2-52e4-4679-bc8a-64881a845a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:12 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Volume 12090146-8443-42d9-9ad2-d22725bd58a4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-12090146-8443-42d9-9ad2-d22725bd58a4', 'volume_size': 1, 'source_volid': '83cee2ff-316c-4817-b1d5-554d8c62792f', 'source_volstatus': 'available'} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:12 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Cloning volume 83cee2ff-316c-4817-b1d5-554d8c62792f to volume 12090146-8443-42d9-9ad2-d22725bd58a4 Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Creating offline snapshot 909de743-f62e-4152-ae73-010572d2b8aa of volume 83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d2a36-bc60-471e-9f39-d9186cdd8e4f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:12 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f Sep 16 16:26:12 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:12 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f" returned: 0 in 0.411s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:12 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa 1G Sep 16 16:26:12 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:13 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa 1G" returned: 0 in 0.411s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83cee2ff-316c-4817-b1d5-554d8c62792f -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:13 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83cee2ff-316c-4817-b1d5-554d8c62792f -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa Sep 16 16:26:13 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:13 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83cee2ff-316c-4817-b1d5-554d8c62792f -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa" returned: 0 in 0.397s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:13 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa is being set with open permissions: ugo+rw Sep 16 16:26:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:13 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa Sep 16 16:26:13 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:13 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa" returned: 0 in 0.253s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:13 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.info Sep 16 16:26:13 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:14 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.info" returned: 0 in 0.280s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:14 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.info is being set with open permissions: ugo+rw Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:14 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.info Sep 16 16:26:14 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:14 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.info" returned: 0 in 0.330s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-quobyte-12090146-8443-42d9-9ad2-d22725bd58a4" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-12090146-8443-42d9-9ad2-d22725bd58a4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] snapshot: 909de743-f62e-4152-ae73-010572d2b8aa, volume: 12090146-8443-42d9-9ad2-d22725bd58a4, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[19862761-9351-4a02-bc90-fdb7cd438feb]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:14 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa Sep 16 16:26:14 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:14 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa" returned: 0 in 0.388s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83cee2ff-316c-4817-b1d5-554d8c62792f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[418bc1d3-a728-407e-a86d-56410f00e9bf]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:15 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f Sep 16 16:26:15 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:15 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f" returned: 0 in 0.403s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:26:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:26:15 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:26:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:15 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 Sep 16 16:26:15 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:22 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4" returned: 0 in 6.953s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:26:22 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Converted 1024.00 MB image at 147.24 MB/s Sep 16 16:26:22 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 is being set with open permissions: ugo+rw Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:22 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 Sep 16 16:26:22 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:22 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4" returned: 0 in 0.266s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-12090146-8443-42d9-9ad2-d22725bd58a4" released by "_copy_volume_from_snapshot" :: held 8.095s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=79,cinder:UPDATE=91,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-quobyte-909de743-f62e-4152-ae73-010572d2b8aa" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-909de743-f62e-4152-ae73-010572d2b8aa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Deleting offline snapshot 909de743-f62e-4152-ae73-010572d2b8aa of volume 83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] snapshot_file for this snap is: volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd1762d-58b9-415b-82f4-b203d4ad24b7]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:22 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa Sep 16 16:26:22 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:23 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa" returned: 0 in 0.414s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83cee2ff-316c-4817-b1d5-554d8c62792f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:26:23 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b2b0a-aa5e-4bf0-bb3b-beaac7395780]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:23 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f Sep 16 16:26:23 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:23 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f" returned: 0 in 0.580s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:23 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa Sep 16 16:26:23 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:23 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=110,cinder:INSERT=20,cinder:DELETE=9,cinder:SELECT=83 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:26:24 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa" returned: 0 in 0.353s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:24 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa Sep 16 16:26:24 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:24 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f.909de743-f62e-4152-ae73-010572d2b8aa" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-909de743-f62e-4152-ae73-010572d2b8aa" released by "_delete_snapshot" :: held 1.761s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.145s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2474a3f2-52e4-4679-bc8a-64881a845a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12090146-8443-42d9-9ad2-d22725bd58a4', 'volume_size': 1, 'source_volid': '83cee2ff-316c-4817-b1d5-554d8c62792f', 'source_volstatus': 'available'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da24e771-959f-44ab-824c-2f119310c990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:24 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Volume volume-12090146-8443-42d9-9ad2-d22725bd58a4 (12090146-8443-42d9-9ad2-d22725bd58a4): created successfully Sep 16 16:26:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da24e771-959f-44ab-824c-2f119310c990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (905d014e-f457-4ffe-9061-fa9f32c01963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:24 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-65534e1b-a3e5-465f-bc3a-e812e0f1009f tempest-VolumesGetTest-1629182632 None] Created volume successfully. Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (39092b16-0801-4348-ab50-3358c183fe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bffcfa5-01e7-44c4-bc49-9bc644f71847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bffcfa5-01e7-44c4-bc49-9bc644f71847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1332630831',display_name='tempest-VolumesGetTest-Volume-1550310096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:26Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38ff3b9-4f45-450f-bfcf-9612acc62522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38ff3b9-4f45-450f-bfcf-9612acc62522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7075f435-639e-4af7-83f5-0b9d89f9f58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7075f435-639e-4af7-83f5-0b9d89f9f58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac', 'volume_name': 'volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff16ff93-76bc-43f4-888c-515728c2c8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff16ff93-76bc-43f4-888c-515728c2c8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c4e787-bc26-466a-a360-679806b0e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:26 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Volume b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac', 'volume_size': 1} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1332630831',display_name='tempest-VolumesGetTest-Volume-1550310096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:26Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Creating volume b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:26:26 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:26 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac 1073741824 Sep 16 16:26:26 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:26 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac 1073741824" returned: 0 in 0.529s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:26 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac Sep 16 16:26:26 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:27 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac" returned: 0 in 0.300s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:26:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c4e787-bc26-466a-a360-679806b0e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb3c33f-c882-4c05-9267-24578ebe0706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:27 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Volume volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac (b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac): created successfully Sep 16 16:26:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb3c33f-c882-4c05-9267-24578ebe0706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:27 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (39092b16-0801-4348-ab50-3358c183fe49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:27 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2a069fa4-8fe2-45e1-885e-54da557b3a86 tempest-VolumesGetTest-1629182632 None] Created volume successfully. Sep 16 16:26:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Lock "cinder-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-quobyte-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:28 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:28 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a21c6c-e8ff-40fb-9d37-ed6177bea830]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:28 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac Sep 16 16:26:28 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:29 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac" returned: 0 in 0.455s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:29 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac Sep 16 16:26:29 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:29 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac" returned: 0 in 0.318s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac" released by "delete_volume" :: held 0.858s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Created reservations ['7d5ccf20-5e8a-462e-82a8-0aa17193d5ca', 'ef9d341f-b433-401e-a8ce-e214842a4882', '578e67ca-53eb-4eda-b70c-abe1212ac988', '83440898-75ef-4de9-81c2-51137a9fdaa9'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:29 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:29 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-12090146-8443-42d9-9ad2-d22725bd58a4-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Lock "cinder-12090146-8443-42d9-9ad2-d22725bd58a4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:30 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.383s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-quobyte-12090146-8443-42d9-9ad2-d22725bd58a4" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:30 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Deleted volume successfully. Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-12090146-8443-42d9-9ad2-d22725bd58a4" acquired by "delete_volume" :: waited 0.038s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c0c97fdd-7cca-4dc5-93dc-0b1f2ddd4bc3 tempest-VolumesGetTest-1629182632 None] Lock "cinder-b2ddcdf7-1fe7-4994-877a-1c8e9761c0ac-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b5cf63-fde2-4417-a071-85227c3a46f9]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:30 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 Sep 16 16:26:30 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:30 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4" returned: 0 in 0.458s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:30 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4 Sep 16 16:26:30 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:30 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-12090146-8443-42d9-9ad2-d22725bd58a4" returned: 0 in 0.300s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-12090146-8443-42d9-9ad2-d22725bd58a4" released by "delete_volume" :: held 0.832s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:30 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Created reservations ['767193e0-af2b-43d4-9615-2df8b7ea0402', '4d5fbbbb-bb11-4e81-80c9-ecaedc3bf903', 'f32d5d73-0b2c-4727-98b6-a27b6188bbf9', '3d87e3e4-905d-4486-9875-283a77318eee'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:31 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:31 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-83cee2ff-316c-4817-b1d5-554d8c62792f-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Lock "cinder-83cee2ff-316c-4817-b1d5-554d8c62792f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-quobyte-83cee2ff-316c-4817-b1d5-554d8c62792f" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-83cee2ff-316c-4817-b1d5-554d8c62792f" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e92edf-ef88-413e-af64-f1c23c39bf25]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:31 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.358s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Deleted volume successfully. Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8d09c33f-d9ba-499c-9d08-dcd02f707d79 tempest-VolumesGetTest-1629182632 None] Lock "cinder-12090146-8443-42d9-9ad2-d22725bd58a4-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:31 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f Sep 16 16:26:31 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:31 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f" returned: 0 in 0.488s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:31 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f Sep 16 16:26:31 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:32 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-83cee2ff-316c-4817-b1d5-554d8c62792f" returned: 0 in 0.275s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-83cee2ff-316c-4817-b1d5-554d8c62792f" released by "delete_volume" :: held 0.844s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Created reservations ['bfd167eb-518a-4466-89d3-d34666b17fb5', 'de8c6b6a-5feb-493c-ba5b-b3988e8f0b3c', 'b74b26bd-7539-43be-aaff-400fe90a3c70', '12fde234-ea23-4b05-a7f6-e93b0ae2f84e'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:32 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:32 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:32 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.322s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Deleted volume successfully. Sep 16 16:26:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-cf5047a1-74d6-4fd0-93a1-089cc3c10efd tempest-VolumesGetTest-1629182632 None] Lock "cinder-83cee2ff-316c-4817-b1d5-554d8c62792f-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (ad4709c0-a772-4e2f-b3ac-686e4ac7b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff8b665-8572-4811-9993-c5d00c99b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff8b665-8572-4811-9993-c5d00c99b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1960478408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc551e2-f6a8-4153-b746-da3928ac843c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:33Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3688e5-85d7-4d01-8da4-8eaeca56e412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3688e5-85d7-4d01-8da4-8eaeca56e412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d68d33-608e-4ed0-9c69-fae2635c6de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d68d33-608e-4ed0-9c69-fae2635c6de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'efc551e2-f6a8-4153-b746-da3928ac843c', 'volume_name': 'volume-efc551e2-f6a8-4153-b746-da3928ac843c', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061dce9f-d3da-42be-af5f-dfac53ed5b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061dce9f-d3da-42be-af5f-dfac53ed5b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80db255c-5cad-49bc-9876-1d9005c07ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Volume efc551e2-f6a8-4153-b746-da3928ac843c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-efc551e2-f6a8-4153-b746-da3928ac843c', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 16:26:33 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Trying to clone efc551e2-f6a8-4153-b746-da3928ac843c from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:26:34 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:26:34 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Image download 20.69 MB at 20.69 MB/s Sep 16 16:26:34 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[16234123-990c-4e28-85e9-c41e9e7c8940]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:34 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD Sep 16 16:26:34 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:34 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:34 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c is fetched for user e22cfe6563f947d8999a077b4eb5324d. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:26:34 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c5780-0750-4759-b2dd-8468dcdda2f1]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:34 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD Sep 16 16:26:34 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:35 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1960478408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc551e2-f6a8-4153-b746-da3928ac843c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:33Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Creating volume efc551e2-f6a8-4153-b746-da3928ac843c {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:26:35 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:35 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c 1073741824 Sep 16 16:26:35 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:35 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c 1073741824" returned: 0 in 0.614s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:35 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c Sep 16 16:26:35 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:36 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c" returned: 0 in 0.279s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Attempting download of cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume efc551e2-f6a8-4153-b746-da3928ac843c. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbe6abe-f7ca-4037-82fd-91691114b15b]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_2_03wk4d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:36 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_2_03wk4d Sep 16 16:26:36 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:36 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_2_03wk4d" returned: 0 in 0.343s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_2_03wk4d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:36 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_2_03wk4d Sep 16 16:26:36 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:36 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_2_03wk4d" returned: 1 in 0.360s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_2_03wk4d' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[72adcc58-e65c-412f-9341-2893642186db]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:36 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD Sep 16 16:26:36 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:37 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:37 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] cceeac4d-0fa7-4694-a045-5c6e3d003f4c was qcow2, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:26:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:37 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c Sep 16 16:26:37 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:39 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c" returned: 0 in 2.120s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cceeac4d-0fa7-4694-a045-5c6e3d003f4c_mbhl26x9devstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:26:39 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Converted 112.00 MB image at 52.81 MB/s Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:39 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c 1G Sep 16 16:26:39 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:39 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c 1G" returned: 0 in 0.387s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Downloaded image cceeac4d-0fa7-4694-a045-5c6e3d003f4c ((None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}])) to volume efc551e2-f6a8-4153-b746-da3928ac843c successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Temporary image cceeac4d-0fa7-4694-a045-5c6e3d003f4c for user e22cfe6563f947d8999a077b4eb5324d is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Marking volume efc551e2-f6a8-4153-b746-da3928ac843c as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Copying metadata from image cceeac4d-0fa7-4694-a045-5c6e3d003f4c to efc551e2-f6a8-4153-b746-da3928ac843c. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Creating volume glance metadata for volume efc551e2-f6a8-4153-b746-da3928ac843c backed by image cceeac4d-0fa7-4694-a045-5c6e3d003f4c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80db255c-5cad-49bc-9876-1d9005c07ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc551e2-f6a8-4153-b746-da3928ac843c', 'volume_size': 1, 'image_id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b19d9062c74e4cbbbc2a449188ffdd32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cceeac4d-0fa7-4694-a045-5c6e3d003f4c', 'created_at': datetime.datetime(2026, 9, 16, 14, 2, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 3, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cceeac4d-0fa7-4694-a045-5c6e3d003f4c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a93adde-a1bf-40d4-82d5-618dd92bde11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:39 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Volume volume-efc551e2-f6a8-4153-b746-da3928ac843c (efc551e2-f6a8-4153-b746-da3928ac843c): created successfully Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a93adde-a1bf-40d4-82d5-618dd92bde11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (ad4709c0-a772-4e2f-b3ac-686e4ac7b977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:39 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3f4dfee9-6401-4669-a5d7-fb8672649f03 tempest-VolumesGetTest-1629182632 None] Created volume successfully. Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (6ff01eea-84d8-439c-a82a-4295e5323ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a064d94a-73bb-411b-ada5-4f4037804d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a064d94a-73bb-411b-ada5-4f4037804d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-573097839',display_name='tempest-VolumesGetTest-Volume-644093085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fb3232-c4f5-4fbe-828b-efe31ed8725f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:41Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6395859-1145-4977-8045-9d4d0bc6e029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6395859-1145-4977-8045-9d4d0bc6e029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940feba1-b688-4b3b-96b9-11562a4ac924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940feba1-b688-4b3b-96b9-11562a4ac924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8fb3232-c4f5-4fbe-828b-efe31ed8725f', 'volume_name': 'volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff6e05d-6117-4be4-9c37-4b62284f29a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff6e05d-6117-4be4-9c37-4b62284f29a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf89228-a6d3-4e90-931f-ea0723523bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:41 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Volume f8fb3232-c4f5-4fbe-828b-efe31ed8725f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f', 'volume_size': 1} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-573097839',display_name='tempest-VolumesGetTest-Volume-644093085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8fb3232-c4f5-4fbe-828b-efe31ed8725f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ad3733da974ec0a2e7b93242ed9c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:41Z,use_quota=True,user_id='e22cfe6563f947d8999a077b4eb5324d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Creating volume f8fb3232-c4f5-4fbe-828b-efe31ed8725f {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:26:41 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:41 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f 1073741824 Sep 16 16:26:41 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:41 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:41 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:42 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.299s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:26:42 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f 1073741824" returned: 0 in 0.506s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:42 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f Sep 16 16:26:42 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:42 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f" returned: 0 in 0.256s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf89228-a6d3-4e90-931f-ea0723523bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5758371-4033-4e30-8855-b5179bc2b25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:42 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Volume volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f (f8fb3232-c4f5-4fbe-828b-efe31ed8725f): created successfully Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5758371-4033-4e30-8855-b5179bc2b25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Flow 'volume_create_manager' (6ff01eea-84d8-439c-a82a-4295e5323ffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-cfa75ea8-df0a-4ded-81e7-76f9fc3c93e9 tempest-VolumesGetTest-1629182632 None] Created volume successfully. Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Flow 'volume_create_manager' (0705b7b6-99a2-45c1-b54b-3ee20361a56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b685cd04-00be-4dc7-a4a5-ea165302b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b685cd04-00be-4dc7-a4a5-ea165302b47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-212414075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f145d0-75f4-487c-b772-0cf9bb3b6d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d61d828c0cd449d8294463785c771a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:43Z,use_quota=True,user_id='ba4c9bd11abe4ffaa95225b5fa95c1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b20db0-7f9c-49e3-b0b1-603e8d7cdb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b20db0-7f9c-49e3-b0b1-603e8d7cdb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec246ef-6839-4276-a128-3d8a6804e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec246ef-6839-4276-a128-3d8a6804e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f145d0-75f4-487c-b772-0cf9bb3b6d0f', 'volume_name': 'volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ef77c2-2283-4b14-b225-30e1269c9e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ef77c2-2283-4b14-b225-30e1269c9e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd120bf-a4cf-48dd-851b-7b3aad992887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:42 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Volume 13f145d0-75f4-487c-b772-0cf9bb3b6d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f', 'volume_size': 1} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-212414075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f145d0-75f4-487c-b772-0cf9bb3b6d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d61d828c0cd449d8294463785c771a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:43Z,use_quota=True,user_id='ba4c9bd11abe4ffaa95225b5fa95c1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Creating volume 13f145d0-75f4-487c-b772-0cf9bb3b6d0f {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:26:42 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:26:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:42 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f 1073741824 Sep 16 16:26:42 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:43 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f 1073741824" returned: 0 in 0.407s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:43 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f Sep 16 16:26:43 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:43 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f" returned: 0 in 0.251s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd120bf-a4cf-48dd-851b-7b3aad992887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92af4af7-80bc-4de7-84dc-c4656fec4d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:43 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Volume volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f (13f145d0-75f4-487c-b772-0cf9bb3b6d0f): created successfully Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92af4af7-80bc-4de7-84dc-c4656fec4d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Flow 'volume_create_manager' (0705b7b6-99a2-45c1-b54b-3ee20361a56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-bfc934f5-1b7f-457a-a621-93b54ebbc591 tempest-TestImageHashVerification-1229059354 None] Created volume successfully. Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-f8fb3232-c4f5-4fbe-828b-efe31ed8725f-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Lock "cinder-f8fb3232-c4f5-4fbe-828b-efe31ed8725f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-quobyte-f8fb3232-c4f5-4fbe-828b-efe31ed8725f" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-f8fb3232-c4f5-4fbe-828b-efe31ed8725f" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[688f5d92-18e8-4c68-a5b5-464d0c3a2da7]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:44 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f Sep 16 16:26:44 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:44 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f" returned: 0 in 0.393s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:44 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f Sep 16 16:26:44 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:44 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f8fb3232-c4f5-4fbe-828b-efe31ed8725f" returned: 0 in 0.257s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-f8fb3232-c4f5-4fbe-828b-efe31ed8725f" released by "delete_volume" :: held 0.698s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Created reservations ['c8e8600e-9e37-4d36-a2cf-a2723fa8b146', 'c104dd1e-cda9-46d7-9a1c-aee4851ac5bc', 'd468b1bd-a7a9-45a6-ad87-dad7a9cd422c', 'be8baa38-06cc-485e-9989-ab3fef779dac'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fadf2e4-7699-4b19-aadd-cb412d2fee87]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:44 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:44 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:44 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f Sep 16 16:26:44 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:45 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.260s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Deleted volume successfully. Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-efc551e2-f6a8-4153-b746-da3928ac843c-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-85005304-d0db-4fb3-a0eb-2347bd3b1645 tempest-VolumesGetTest-1629182632 None] Lock "cinder-f8fb3232-c4f5-4fbe-828b-efe31ed8725f-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Lock "cinder-efc551e2-f6a8-4153-b746-da3928ac843c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Acquiring lock "cinder-quobyte-efc551e2-f6a8-4153-b746-da3928ac843c" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-efc551e2-f6a8-4153-b746-da3928ac843c" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bddfe7a-4ea1-4454-b423-e538ff3ccca4]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:45 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f" returned: 0 in 0.488s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[af69d148-e0d6-4f1a-9c3d-59065aa18097]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:45 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c Sep 16 16:26:45 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:45 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f Sep 16 16:26:45 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:45 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c" returned: 0 in 0.359s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:45 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c Sep 16 16:26:45 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:45 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f" returned: 0 in 0.414s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f /opt/stack/data/cinder/conversion/13f145d0-75f4-487c-b772-0cf9bb3b6d0f.temp_image.9c09fbbc-045f-4038-be38-89d20ba25c7ez2_9va2g.img {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:45 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f /opt/stack/data/cinder/conversion/13f145d0-75f4-487c-b772-0cf9bb3b6d0f.temp_image.9c09fbbc-045f-4038-be38-89d20ba25c7ez2_9va2g.img Sep 16 16:26:45 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:45 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-efc551e2-f6a8-4153-b746-da3928ac843c" returned: 0 in 0.255s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Lock "cinder-quobyte-efc551e2-f6a8-4153-b746-da3928ac843c" released by "delete_volume" :: held 0.660s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Created reservations ['dc7d26ac-b269-41c9-b93d-69d1ee55e6a8', 'd227ec6c-83ee-4b44-950c-0aa55318e76d', '25dad1a9-20fe-49c2-a09e-a6f58aef4cb9', 'c4616bc1-56f2-4f8e-aa42-fed00508051b'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:26:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:45 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:26:45 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:46 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.377s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:46 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:26:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Deleted volume successfully. Sep 16 16:26:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8c5c3e8f-075d-4ea3-8c47-b7dbf5ba177f tempest-VolumesGetTest-1629182632 None] Lock "cinder-efc551e2-f6a8-4153-b746-da3928ac843c-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:26:51 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (80d46be5-f132-4831-8d99-5dfe81e73e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f2e57f-2272-4df7-afd8-93e70166a32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f2e57f-2272-4df7-afd8-93e70166a32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753324390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c34ec6-39a3-4a92-aca7-03a34467d4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:52Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd3134a-c4a9-41f6-ad47-43e056175dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd3134a-c4a9-41f6-ad47-43e056175dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e04eeb7-22aa-471d-8287-5977b0ca762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e04eeb7-22aa-471d-8287-5977b0ca762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78c34ec6-39a3-4a92-aca7-03a34467d4c0', 'volume_name': 'volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8421b818-31c8-4184-9d9a-570f55951bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8421b818-31c8-4184-9d9a-570f55951bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5d74f1-f12f-4017-9ed6-6533708e3011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Volume 78c34ec6-39a3-4a92-aca7-03a34467d4c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0', 'volume_size': 1} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:52 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (000abb7f-5daf-4c73-a23b-62a646401815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02a2dee-25a7-4ae3-b283-432d48218b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f /opt/stack/data/cinder/conversion/13f145d0-75f4-487c-b772-0cf9bb3b6d0f.temp_image.9c09fbbc-045f-4038-be38-89d20ba25c7ez2_9va2g.img" returned: 0 in 6.854s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02a2dee-25a7-4ae3-b283-432d48218b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837948347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e721f77-25ce-44b7-b24e-84271c62a140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:52Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836bc1e2-e408-4cd5-a37b-592de78c5ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836bc1e2-e408-4cd5-a37b-592de78c5ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d00058-16d6-43c8-b9a4-e14cc5d76a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d00058-16d6-43c8-b9a4-e14cc5d76a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e721f77-25ce-44b7-b24e-84271c62a140', 'volume_name': 'volume-4e721f77-25ce-44b7-b24e-84271c62a140', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9ebf0f-6162-493f-8105-ed8184811995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9ebf0f-6162-493f-8105-ed8184811995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14256fa5-9b1d-48e3-b557-5c77ab931dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Volume 4e721f77-25ce-44b7-b24e-84271c62a140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e721f77-25ce-44b7-b24e-84271c62a140', 'volume_size': 1} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0028ee3a-5bb0-4f98-8d7a-83caaebeef5b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:26:52 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f Sep 16 16:26:52 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (7a10f723-baa4-4bb3-9613-a31df8749e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f86b14-fd3d-4651-b1b3-f351b458a4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:52 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f86b14-fd3d-4651-b1b3-f351b458a4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665180581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e323586a-c693-4539-be13-cc8cb867275c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:53Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfa06d0-6699-4a0d-92ee-a8b52a936483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfa06d0-6699-4a0d-92ee-a8b52a936483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e444eb0-e29d-4350-8c0d-b76c9d7e8852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e444eb0-e29d-4350-8c0d-b76c9d7e8852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e323586a-c693-4539-be13-cc8cb867275c', 'volume_name': 'volume-e323586a-c693-4539-be13-cc8cb867275c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791d384f-6e52-46cc-b6a0-be4bb6d5e2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (791d384f-6e52-46cc-b6a0-be4bb6d5e2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b207172-5271-4763-b6bd-bd85a9029030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Volume e323586a-c693-4539-be13-cc8cb867275c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e323586a-c693-4539-be13-cc8cb867275c', 'volume_size': 1} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:53 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f" returned: 0 in 0.634s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/conversion/13f145d0-75f4-487c-b772-0cf9bb3b6d0f.temp_image.9c09fbbc-045f-4038-be38-89d20ba25c7ez2_9va2g.img {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:26:53 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Converted 1024.00 MB image at 149.39 MB/s Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] 9c09fbbc-045f-4038-be38-89d20ba25c7e was raw, no need to convert to raw {{(pid=86255) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (5237e9bd-ff82-45aa-871d-125ee76ac6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a151df2-8acf-4d32-ba8a-e728789e74e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a151df2-8acf-4d32-ba8a-e728789e74e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-713136517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:53Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ab2e8e-62c8-4826-a734-b86c7c838e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ab2e8e-62c8-4826-a734-b86c7c838e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21df64d3-b22d-4759-a7ec-e7426fa84733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21df64d3-b22d-4759-a7ec-e7426fa84733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43', 'volume_name': 'volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f93cc48-0e2c-4c01-bdb8-9c3122cedf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f93cc48-0e2c-4c01-bdb8-9c3122cedf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f0137d-e4b3-4d2a-be2b-acf374b67418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Volume a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43', 'volume_size': 1} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (7a73be63-93ae-4b8e-93f5-606b18fe38ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fbaafd-8be2-4ee2-b296-7997830ad41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97fbaafd-8be2-4ee2-b296-7997830ad41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1096499562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6272697-5e08-457f-94c1-5cff8f450fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:54Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13441db7-8956-42a8-bcd7-54a73fe9520a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13441db7-8956-42a8-bcd7-54a73fe9520a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb447cc-9817-45ee-859e-28a8fd841707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb447cc-9817-45ee-859e-28a8fd841707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6272697-5e08-457f-94c1-5cff8f450fe4', 'volume_name': 'volume-c6272697-5e08-457f-94c1-5cff8f450fe4', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e461b9-04d7-40a5-9b80-3fd7f0cc9764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e461b9-04d7-40a5-9b80-3fd7f0cc9764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c234122c-1bc2-4eda-8d97-e15e665be7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:26:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Volume c6272697-5e08-457f-94c1-5cff8f450fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6272697-5e08-457f-94c1-5cff8f450fe4', 'volume_size': 1} Sep 16 16:26:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:03 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=56,cinder:SELECT=49,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:27:03 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=62,cinder:INSERT=19,cinder:DELETE=5,cinder:SELECT=47 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.482s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Uploaded volume to glance image-id: 9c09fbbc-045f-4038-be38-89d20ba25c7e. {{(pid=86255) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.023s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753324390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c34ec6-39a3-4a92-aca7-03a34467d4c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:52Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Creating volume 78c34ec6-39a3-4a92-aca7-03a34467d4c0 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:12 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:12 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 1073741824 Sep 16 16:27:12 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:12 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b12dfa88-bd34-47c0-bd3c-532d973aae90 tempest-TestImageHashVerification-1229059354 None] Copy volume to image completed successfully. Sep 16 16:27:12 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 1073741824" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:12 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 Sep 16 16:27:12 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:12 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0" returned: 0 in 0.274s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.419s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1837948347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e721f77-25ce-44b7-b24e-84271c62a140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:52Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Creating volume 4e721f77-25ce-44b7-b24e-84271c62a140 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:13 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b5d74f1-f12f-4017-9ed6-6533708e3011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:13 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140 1073741824 Sep 16 16:27:13 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691534b3-8b19-4713-b26e-5f4273b5516d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:13 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Volume volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 (78c34ec6-39a3-4a92-aca7-03a34467d4c0): created successfully Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691534b3-8b19-4713-b26e-5f4273b5516d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (80d46be5-f132-4831-8d99-5dfe81e73e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:13 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ca54ed03-494c-46dd-9469-c9a769e6ac3c tempest-CreateVolumesFromImageTest-1388011717 None] Created volume successfully. Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Acquiring lock "cinder-13f145d0-75f4-487c-b772-0cf9bb3b6d0f-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Lock "cinder-13f145d0-75f4-487c-b772-0cf9bb3b6d0f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Acquiring lock "cinder-quobyte-13f145d0-75f4-487c-b772-0cf9bb3b6d0f" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Lock "cinder-quobyte-13f145d0-75f4-487c-b772-0cf9bb3b6d0f" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db32511-d4b5-46e4-a535-9de4be06f523]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:13 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140 1073741824" returned: 0 in 0.552s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:13 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140 Sep 16 16:27:13 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:13 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f Sep 16 16:27:13 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:13 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140" returned: 0 in 0.311s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:13 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.874s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665180581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e323586a-c693-4539-be13-cc8cb867275c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:53Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Creating volume e323586a-c693-4539-be13-cc8cb867275c {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:13 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f" returned: 0 in 0.439s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:13 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c 1073741824 Sep 16 16:27:13 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14256fa5-9b1d-48e3-b557-5c77ab931dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e721f77-25ce-44b7-b24e-84271c62a140', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9983b810-9249-472c-a573-dca68d490114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:13 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f Sep 16 16:27:13 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:13 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Volume volume-4e721f77-25ce-44b7-b24e-84271c62a140 (4e721f77-25ce-44b7-b24e-84271c62a140): created successfully Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9983b810-9249-472c-a573-dca68d490114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (000abb7f-5daf-4c73-a23b-62a646401815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8c6c4dfc-24ee-4297-ac2e-d0a3eba26827 tempest-CreateVolumesFromImageTest-1388011717 None] Created volume successfully. Sep 16 16:27:14 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-13f145d0-75f4-487c-b772-0cf9bb3b6d0f" returned: 0 in 0.288s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Lock "cinder-quobyte-13f145d0-75f4-487c-b772-0cf9bb3b6d0f" released by "delete_volume" :: held 0.774s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Created reservations ['51ee2e5b-8b32-4250-b400-19c3ea1c409e', 'bdd1e445-7bfe-4ee4-814c-b233d05bfe31', '37fb8adb-1e4e-4272-b43b-8c52983bad1b', 'd40b6e23-b757-475e-ae73-487b60854a3f'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:14 devstack sudo[104332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:14 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:14 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c 1073741824" returned: 0 in 0.542s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:14 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c Sep 16 16:27:14 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:14 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.274s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Deleted volume successfully. Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f7da9bb0-e474-4766-90c7-d64d2bd8d858 tempest-TestImageHashVerification-1229059354 None] Lock "cinder-13f145d0-75f4-487c-b772-0cf9bb3b6d0f-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:14 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.400s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-713136517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:53Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Creating volume a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:14 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:14 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 1073741824 Sep 16 16:27:14 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b207172-5271-4763-b6bd-bd85a9029030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e323586a-c693-4539-be13-cc8cb867275c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da094c75-41e6-48ef-b9da-46361d7f5918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:14 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Volume volume-e323586a-c693-4539-be13-cc8cb867275c (e323586a-c693-4539-be13-cc8cb867275c): created successfully Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da094c75-41e6-48ef-b9da-46361d7f5918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (7a10f723-baa4-4bb3-9613-a31df8749e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9e3c2b96-ead9-4707-98f7-e8405bed26cf tempest-CreateVolumesFromImageTest-1388011717 None] Created volume successfully. Sep 16 16:27:15 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 1073741824" returned: 0 in 0.567s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:15 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 Sep 16 16:27:15 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:15 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43" returned: 0 in 0.321s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.040s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1096499562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6272697-5e08-457f-94c1-5cff8f450fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d0fd9f8bb044b8795f39ce050bee727',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:26:54Z,use_quota=True,user_id='29a5f56161594f12a4e3066b53095800',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Creating volume c6272697-5e08-457f-94c1-5cff8f450fe4 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:15 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:15 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4 1073741824 Sep 16 16:27:15 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f0137d-e4b3-4d2a-be2b-acf374b67418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b3c356-735f-43fe-a088-ab024a360744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:15 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Volume volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 (a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43): created successfully Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b3c356-735f-43fe-a088-ab024a360744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:15 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (5237e9bd-ff82-45aa-871d-125ee76ac6d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:15 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4a1384bf-7f89-484b-87c9-729067392355 tempest-CreateVolumesFromImageTest-1388011717 None] Created volume successfully. Sep 16 16:27:16 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4 1073741824" returned: 0 in 0.586s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:16 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4 Sep 16 16:27:16 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:16 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4" returned: 0 in 0.317s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:16 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c234122c-1bc2-4eda-8d97-e15e665be7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6272697-5e08-457f-94c1-5cff8f450fe4', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914c557f-cc7e-4583-a9b8-1f0f56aff20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:16 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Volume volume-c6272697-5e08-457f-94c1-5cff8f450fe4 (c6272697-5e08-457f-94c1-5cff8f450fe4): created successfully Sep 16 16:27:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914c557f-cc7e-4583-a9b8-1f0f56aff20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Flow 'volume_create_manager' (7a73be63-93ae-4b8e-93f5-606b18fe38ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-548977a8-f084-48e4-8e2e-c7bf21668624 tempest-CreateVolumesFromImageTest-1388011717 None] Created volume successfully. Sep 16 16:27:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-c6272697-5e08-457f-94c1-5cff8f450fe4-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-c6272697-5e08-457f-94c1-5cff8f450fe4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-quobyte-c6272697-5e08-457f-94c1-5cff8f450fe4" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-c6272697-5e08-457f-94c1-5cff8f450fe4" acquired by "delete_volume" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:17 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3712fe0-3231-4fdf-8499-f28068cb4519]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:17 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4 Sep 16 16:27:17 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:17 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4" returned: 0 in 0.398s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:18 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4 Sep 16 16:27:18 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:18 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c6272697-5e08-457f-94c1-5cff8f450fe4" returned: 0 in 0.257s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-c6272697-5e08-457f-94c1-5cff8f450fe4" released by "delete_volume" :: held 0.700s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Created reservations ['27bda9a9-7fd9-4f70-8a9b-124896c24e81', '320c2ade-3ece-4d92-9b7e-f2a6e21d9b7e', 'de43fba8-55df-4974-8211-a82517d66da3', '4b5cd4f3-6f62-40e0-8868-facd64918609'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:18 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:18 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:18 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.282s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Deleted volume successfully. Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1fa3971f-1771-4b55-987c-49dbd5440f81 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-c6272697-5e08-457f-94c1-5cff8f450fe4-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-quobyte-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29cde59-7e1c-4b77-9378-aaad2797bb3e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:19 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 Sep 16 16:27:19 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:19 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43" returned: 0 in 0.417s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:19 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43 Sep 16 16:27:19 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:19 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43" returned: 0 in 0.266s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43" released by "delete_volume" :: held 0.789s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Created reservations ['29cfa162-851e-456c-b3cc-17775d8fd2b0', '7ac4c0ce-4b91-48be-9ee9-ad76a703a8c4', '35a9488a-9620-45bb-90de-331dca4762b1', 'd451e566-d490-4b69-a0c5-1db393e45aec'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:19 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:19 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-e323586a-c693-4539-be13-cc8cb867275c-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-e323586a-c693-4539-be13-cc8cb867275c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-quobyte-e323586a-c693-4539-be13-cc8cb867275c" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-e323586a-c693-4539-be13-cc8cb867275c" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f977d62-0257-4c60-b65e-f572a3f508e1]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:20 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.318s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:20 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Deleted volume successfully. Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-82f9f9ea-4b56-4cbf-a9e4-6c86112ffd8b tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-a8a2abd5-6d7e-4785-b7a3-d6e3bdb62b43-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:20 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c Sep 16 16:27:20 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:20 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c" returned: 0 in 0.420s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:20 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c Sep 16 16:27:20 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:20 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e323586a-c693-4539-be13-cc8cb867275c" returned: 0 in 0.277s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-e323586a-c693-4539-be13-cc8cb867275c" released by "delete_volume" :: held 0.778s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Created reservations ['a56ef1c1-688c-4473-bf2f-f1db85dfbe7d', 'b4409ebb-5e43-463e-88fa-e48a895abfd5', '3bd46739-d172-4e01-839e-8cd5fde84a83', '1006759a-630c-49c1-8ca5-c438ca1766bd'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:21 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:21 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-4e721f77-25ce-44b7-b24e-84271c62a140-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-4e721f77-25ce-44b7-b24e-84271c62a140-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-quobyte-4e721f77-25ce-44b7-b24e-84271c62a140" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-4e721f77-25ce-44b7-b24e-84271c62a140" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f24b056-766d-4014-a216-3143619ddf24]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:21 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.309s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:21 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Deleted volume successfully. Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-798fb3f0-3e61-4bfd-9f2a-65302ebf849c tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-e323586a-c693-4539-be13-cc8cb867275c-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:21 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140 Sep 16 16:27:21 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:21 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140" returned: 0 in 0.461s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:21 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140 Sep 16 16:27:21 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:22 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4e721f77-25ce-44b7-b24e-84271c62a140" returned: 0 in 0.295s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-4e721f77-25ce-44b7-b24e-84271c62a140" released by "delete_volume" :: held 0.804s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Created reservations ['bdb32afb-0e05-4953-a7f1-d2a11440a527', 'd2cd5c8c-2b01-4875-8ba6-86c49fd4e69d', 'a2b062ee-fb8a-484d-b2e9-0e683ba9de19', 'e5240ffa-f618-46ab-815f-4c5f6c2d5b8b'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:22 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:22 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-78c34ec6-39a3-4a92-aca7-03a34467d4c0-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-78c34ec6-39a3-4a92-aca7-03a34467d4c0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "cinder-quobyte-78c34ec6-39a3-4a92-aca7-03a34467d4c0" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-78c34ec6-39a3-4a92-aca7-03a34467d4c0" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307e771-236e-426a-9fcb-9d5d625690dd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:22 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.298s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Deleted volume successfully. Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e99ffd68-8a42-422c-9b8b-a908b96f36d0 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-4e721f77-25ce-44b7-b24e-84271c62a140-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:22 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 Sep 16 16:27:22 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:22 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0" returned: 0 in 0.461s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:22 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0 Sep 16 16:27:22 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:23 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-78c34ec6-39a3-4a92-aca7-03a34467d4c0" returned: 0 in 0.279s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-quobyte-78c34ec6-39a3-4a92-aca7-03a34467d4c0" released by "delete_volume" :: held 0.795s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Created reservations ['880b3e2a-bdc9-45ab-923d-e869f9fc6476', '2e95b6f6-2dab-424f-b951-4fbf52fb369e', '82b37c52-d2f3-4ba6-8c30-6477dc0113ca', 'eb5e0dc6-acd3-4c8d-9146-56c518c5ae13'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:23 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:23 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:23 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.278s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:23 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Deleted volume successfully. Sep 16 16:27:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e39a2d4c-65ab-4dda-92be-945dd167b516 tempest-CreateVolumesFromImageTest-1388011717 None] Lock "cinder-78c34ec6-39a3-4a92-aca7-03a34467d4c0-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (06f857a6-e8b6-4256-a8b9-eb753d437f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55097d09-3525-4747-9df9-65bf71f55024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55097d09-3525-4747-9df9-65bf71f55024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571081207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:29Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1baaea4-d59f-4da8-9760-d568280067ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1baaea4-d59f-4da8-9760-d568280067ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708c3ccc-8ec2-4ca4-8162-55d2e60c4efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708c3ccc-8ec2-4ca4-8162-55d2e60c4efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b', 'volume_name': 'volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4718cf-004a-4ab3-b37f-0c3116cfb420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4718cf-004a-4ab3-b37f-0c3116cfb420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449e81f8-8ad2-4b65-8734-6baf7fa8a3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:29 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume 9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b', 'volume_size': 1} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1571081207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:29Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Creating volume 9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:29 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:29 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b 1073741824 Sep 16 16:27:29 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:29 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b 1073741824" returned: 0 in 0.465s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:29 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b Sep 16 16:27:29 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:29 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" returned: 0 in 0.277s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449e81f8-8ad2-4b65-8734-6baf7fa8a3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b28472-732a-402d-a791-4adc6114b3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:29 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b (9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b): created successfully Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b28472-732a-402d-a791-4adc6114b3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (06f857a6-e8b6-4256-a8b9-eb753d437f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-10e6c204-ee59-41f7-8644-e369aa7c7856 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created volume successfully. Sep 16 16:27:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Creating offline snapshot b65fe072-1855-48a9-8ed0-556dab083c69 of volume 9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:27:31 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d71b97-72dc-4abb-8b0a-61a6766a97d6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:31 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b Sep 16 16:27:31 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:31 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" returned: 0 in 0.440s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:31 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 1G Sep 16 16:27:31 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:32 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 1G" returned: 0 in 0.558s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:32 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 Sep 16 16:27:32 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:32 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69" returned: 0 in 0.349s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:32 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 is being set with open permissions: ugo+rw Sep 16 16:27:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:32 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 Sep 16 16:27:32 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:33 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69" returned: 0 in 0.313s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:33 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.info Sep 16 16:27:33 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:33 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.info" returned: 0 in 0.298s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:33 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.info is being set with open permissions: ugo+rw Sep 16 16:27:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:33 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.info Sep 16 16:27:33 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:33 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.info" returned: 0 in 0.282s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:33 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-dc20e7d0-6ad2-4117-bfd4-c64580623a35 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Create snapshot completed successfully Sep 16 16:27:34 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:27:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (834e0724-03c5-401f-ab5e-781bb490a89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e9a8a4-c43a-4dbb-99ad-058431cd6825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e9a8a4-c43a-4dbb-99ad-058431cd6825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85484939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79826f65-b3e3-46cd-9910-b6410629a1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:35Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea14cdc3-6f37-499a-b3d8-187a50cc5abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea14cdc3-6f37-499a-b3d8-187a50cc5abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d1399a-46bc-4404-bbb6-9c025d12785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14d1399a-46bc-4404-bbb6-9c025d12785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79826f65-b3e3-46cd-9910-b6410629a1de', 'volume_name': 'volume-79826f65-b3e3-46cd-9910-b6410629a1de', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a38d29-5ea5-43a0-b531-eabfb43cf977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a38d29-5ea5-43a0-b531-eabfb43cf977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8e5714-d533-4901-a1a0-95291e37e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume 79826f65-b3e3-46cd-9910-b6410629a1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79826f65-b3e3-46cd-9910-b6410629a1de', 'volume_size': 1} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85484939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79826f65-b3e3-46cd-9910-b6410629a1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:35Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Creating volume 79826f65-b3e3-46cd-9910-b6410629a1de {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:35 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:35 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de 1073741824 Sep 16 16:27:35 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (81801f73-bce4-4454-bdc6-089846222d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16506abf-daa8-4b5e-adc2-04c642ff1bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16506abf-daa8-4b5e-adc2-04c642ff1bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766738497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930c6f49-9810-4d87-9002-c93586295eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:35Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece5bc6d-e0ef-4fd4-ae90-fb83ac0de8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece5bc6d-e0ef-4fd4-ae90-fb83ac0de8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e593ce-82dc-41f0-a40e-7ea9513faa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e593ce-82dc-41f0-a40e-7ea9513faa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930c6f49-9810-4d87-9002-c93586295eff', 'volume_name': 'volume-930c6f49-9810-4d87-9002-c93586295eff', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e78dd69-db69-42a6-80f0-fb8e406b7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e78dd69-db69-42a6-80f0-fb8e406b7b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9276cd2-0267-4633-83fc-ab7efebdd718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume 930c6f49-9810-4d87-9002-c93586295eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930c6f49-9810-4d87-9002-c93586295eff', 'volume_size': 1} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:35 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de 1073741824" returned: 0 in 0.661s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:35 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de Sep 16 16:27:35 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:36 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de" returned: 0 in 0.350s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1766738497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930c6f49-9810-4d87-9002-c93586295eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:35Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Creating volume 930c6f49-9810-4d87-9002-c93586295eff {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:36 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:36 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff 1073741824 Sep 16 16:27:36 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c8e5714-d533-4901-a1a0-95291e37e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79826f65-b3e3-46cd-9910-b6410629a1de', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f2c796-b516-4d29-9270-ffdb94388259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (e8a27936-3a8a-4722-b25a-d7685e4f3fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b7f0a5-6ef8-4481-96d2-c0cfe383417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume volume-79826f65-b3e3-46cd-9910-b6410629a1de (79826f65-b3e3-46cd-9910-b6410629a1de): created successfully Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f2c796-b516-4d29-9270-ffdb94388259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (834e0724-03c5-401f-ab5e-781bb490a89b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32b7f0a5-6ef8-4481-96d2-c0cfe383417c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835925176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea40e646-18c1-4f33-8506-4a86a6c89e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:36Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aeffebb-864d-404d-ba2b-94c6a56bed66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aeffebb-864d-404d-ba2b-94c6a56bed66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fb18a4-1cc8-4cf0-8286-1c9c21fcbe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fb18a4-1cc8-4cf0-8286-1c9c21fcbe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea40e646-18c1-4f33-8506-4a86a6c89e18', 'volume_name': 'volume-ea40e646-18c1-4f33-8506-4a86a6c89e18', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8bf146-cf11-4197-9b0a-71fe3dbfe8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e8bf146-cf11-4197-9b0a-71fe3dbfe8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e2810a-ad74-4e36-97bd-ee7fb072ab7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume ea40e646-18c1-4f33-8506-4a86a6c89e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea40e646-18c1-4f33-8506-4a86a6c89e18', 'volume_size': 1} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a47ccb15-f938-4f79-a2bc-504ec9ac1c07 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created volume successfully. Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:27:36 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (9d63de13-3571-493e-8f63-c364106027a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14d314b-6607-4d7b-a61b-9920cab883fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff 1073741824" returned: 0 in 0.655s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14d314b-6607-4d7b-a61b-9920cab883fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092547440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8458da28-ba2b-4a77-bcb9-683aa85e05af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:37Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbeedb95-d514-4b8a-ac8e-0f44402e72cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbeedb95-d514-4b8a-ac8e-0f44402e72cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcdf96d-cced-42ed-b52e-aee68136f438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddcdf96d-cced-42ed-b52e-aee68136f438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8458da28-ba2b-4a77-bcb9-683aa85e05af', 'volume_name': 'volume-8458da28-ba2b-4a77-bcb9-683aa85e05af', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a804ee7-ba76-4095-ab9d-3933185c6191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a804ee7-ba76-4095-ab9d-3933185c6191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7fc4ef-3714-49cb-b667-857219954e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:36 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume 8458da28-ba2b-4a77-bcb9-683aa85e05af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8458da28-ba2b-4a77-bcb9-683aa85e05af', 'volume_size': 1} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:36 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff Sep 16 16:27:36 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (a8266bfb-4dd1-4164-bab8-5193e7e278aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a0cc5d-c65c-4b97-81ca-98218edf0fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a0cc5d-c65c-4b97-81ca-98218edf0fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1877162085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699e9d9a-1f21-4fd0-b6be-71956f0bc668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:37Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba7ff9d-8b42-4353-a370-ce94c641bbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba7ff9d-8b42-4353-a370-ce94c641bbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230e66fe-1255-4c12-9009-3294158aed22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:37 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (230e66fe-1255-4c12-9009-3294158aed22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '699e9d9a-1f21-4fd0-b6be-71956f0bc668', 'volume_name': 'volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21520548-b985-401c-82aa-d7d083f2a621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21520548-b985-401c-82aa-d7d083f2a621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07eb531a-e49c-41cd-97fe-4a9ae0f8ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume 699e9d9a-1f21-4fd0-b6be-71956f0bc668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668', 'volume_size': 1} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff" returned: 0 in 0.418s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835925176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea40e646-18c1-4f33-8506-4a86a6c89e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:36Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Creating volume ea40e646-18c1-4f33-8506-4a86a6c89e18 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:37 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9276cd2-0267-4633-83fc-ab7efebdd718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930c6f49-9810-4d87-9002-c93586295eff', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:37 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 1073741824 Sep 16 16:27:37 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab35348-5c04-46ed-9d61-fd65ed3b9b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume volume-930c6f49-9810-4d87-9002-c93586295eff (930c6f49-9810-4d87-9002-c93586295eff): created successfully Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab35348-5c04-46ed-9d61-fd65ed3b9b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (81801f73-bce4-4454-bdc6-089846222d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2144719b-f82f-43f9-91b1-6fb3a57ed04d tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created volume successfully. Sep 16 16:27:37 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 1073741824" returned: 0 in 0.513s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:37 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 Sep 16 16:27:37 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:38 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18" returned: 0 in 0.272s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092547440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8458da28-ba2b-4a77-bcb9-683aa85e05af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:37Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Creating volume 8458da28-ba2b-4a77-bcb9-683aa85e05af {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:38 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e2810a-ad74-4e36-97bd-ee7fb072ab7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea40e646-18c1-4f33-8506-4a86a6c89e18', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:38 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af 1073741824 Sep 16 16:27:38 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ce4fcd-aea1-4dbf-94bc-96fe36f8d7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:38 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 (ea40e646-18c1-4f33-8506-4a86a6c89e18): created successfully Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ce4fcd-aea1-4dbf-94bc-96fe36f8d7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (e8a27936-3a8a-4722-b25a-d7685e4f3fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-48fc0704-b606-4bbc-ab52-ba5cfae7b651 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created volume successfully. Sep 16 16:27:38 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af 1073741824" returned: 0 in 0.524s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:38 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af Sep 16 16:27:38 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:39 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af" returned: 0 in 0.266s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1877162085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=699e9d9a-1f21-4fd0-b6be-71956f0bc668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e22d537f1b984df0b8ba20bc77911a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:37Z,use_quota=True,user_id='e03c167575de43ec9abdfd8dc45ad85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Creating volume 699e9d9a-1f21-4fd0-b6be-71956f0bc668 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:39 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7fc4ef-3714-49cb-b667-857219954e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8458da28-ba2b-4a77-bcb9-683aa85e05af', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd387e79-2ee4-4c9b-b10d-f76cdaba320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:39 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 1073741824 Sep 16 16:27:39 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:39 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume volume-8458da28-ba2b-4a77-bcb9-683aa85e05af (8458da28-ba2b-4a77-bcb9-683aa85e05af): created successfully Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd387e79-2ee4-4c9b-b10d-f76cdaba320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (9d63de13-3571-493e-8f63-c364106027a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:39 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-24bcdc21-8283-44a3-bf88-360958503cfa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created volume successfully. Sep 16 16:27:39 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 1073741824" returned: 0 in 0.543s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:39 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 Sep 16 16:27:39 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:40 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668" returned: 0 in 0.331s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07eb531a-e49c-41cd-97fe-4a9ae0f8ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b157862a-cbc6-4dbb-9f08-aded5f7f69ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:40 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Volume volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 (699e9d9a-1f21-4fd0-b6be-71956f0bc668): created successfully Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b157862a-cbc6-4dbb-9f08-aded5f7f69ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Flow 'volume_create_manager' (a8266bfb-4dd1-4164-bab8-5193e7e278aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2d5a7510-119f-4e28-9893-3780d87473ce tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created volume successfully. Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-699e9d9a-1f21-4fd0-b6be-71956f0bc668-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-699e9d9a-1f21-4fd0-b6be-71956f0bc668-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-quobyte-699e9d9a-1f21-4fd0-b6be-71956f0bc668" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-699e9d9a-1f21-4fd0-b6be-71956f0bc668" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd96d63-1472-4e80-bb70-2a9fffa111ee]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:40 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 Sep 16 16:27:40 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:41 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668" returned: 0 in 0.385s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:41 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668 Sep 16 16:27:41 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:41 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-699e9d9a-1f21-4fd0-b6be-71956f0bc668" returned: 0 in 0.256s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-699e9d9a-1f21-4fd0-b6be-71956f0bc668" released by "delete_volume" :: held 0.697s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created reservations ['d1efc54f-3b1f-4338-92e5-b78f042ded4d', '8d48d50d-ec6f-4ea7-aabe-dae917f93bb7', 'a7b041ec-09a7-48a9-9364-c9e081a60903', 'f9987058-6442-401b-9370-129c31b0c815'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:41 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:41 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:41 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:41 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:42 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-8458da28-ba2b-4a77-bcb9-683aa85e05af-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.412s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Deleted volume successfully. Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-8458da28-ba2b-4a77-bcb9-683aa85e05af-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:42 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.427s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-46ec5533-b98f-4e03-89bb-9ecee8a7a0ca tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-699e9d9a-1f21-4fd0-b6be-71956f0bc668-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-quobyte-8458da28-ba2b-4a77-bcb9-683aa85e05af" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-8458da28-ba2b-4a77-bcb9-683aa85e05af" acquired by "delete_volume" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db913fb-bbbf-4719-8f8b-1d518be1ece0]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:42 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af Sep 16 16:27:42 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:42 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af" returned: 0 in 0.431s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:42 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af Sep 16 16:27:42 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:42 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8458da28-ba2b-4a77-bcb9-683aa85e05af" returned: 0 in 0.278s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-8458da28-ba2b-4a77-bcb9-683aa85e05af" released by "delete_volume" :: held 0.761s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created reservations ['0a2accc3-f0f5-4b62-99bb-038d81b56e31', 'a7c59f65-571e-4237-8dba-8e4ab14c20c1', 'e4279ec8-1e7d-41dd-b116-c3efbcdac3eb', 'bf8b9033-89c0-401a-b173-8ce2a21a8235'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:43 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:43 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-ea40e646-18c1-4f33-8506-4a86a6c89e18-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-ea40e646-18c1-4f33-8506-4a86a6c89e18-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-quobyte-ea40e646-18c1-4f33-8506-4a86a6c89e18" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-ea40e646-18c1-4f33-8506-4a86a6c89e18" acquired by "delete_volume" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:43 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c661e2e9-e38e-44b9-aa64-9f07499ba13b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.344s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Deleted volume successfully. Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e8adf02d-71a0-46b9-be71-bbee824daad8 tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-8458da28-ba2b-4a77-bcb9-683aa85e05af-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:43 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 Sep 16 16:27:43 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:43 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18" returned: 0 in 0.455s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:43 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18 Sep 16 16:27:43 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:44 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ea40e646-18c1-4f33-8506-4a86a6c89e18" returned: 0 in 0.349s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-ea40e646-18c1-4f33-8506-4a86a6c89e18" released by "delete_volume" :: held 0.884s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created reservations ['33cf4b52-42cd-4f89-ade8-2008bc3b6ce5', 'cf6361a2-5b54-4642-aa65-472ab21c9e44', '2d4715d3-ba80-43ec-8870-7c58ef3a8754', 'c57ff0e8-89d1-4db9-a83e-45dbb51b4946'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:44 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:44 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-930c6f49-9810-4d87-9002-c93586295eff-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-930c6f49-9810-4d87-9002-c93586295eff-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-quobyte-930c6f49-9810-4d87-9002-c93586295eff" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-930c6f49-9810-4d87-9002-c93586295eff" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea874a8-4dee-4427-b57b-14070065bf68]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:44 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.380s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Deleted volume successfully. Sep 16 16:27:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a2d6520-8518-41ce-a138-28f6253a758b tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-ea40e646-18c1-4f33-8506-4a86a6c89e18-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:44 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff Sep 16 16:27:44 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:45 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff" returned: 0 in 0.429s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:45 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff Sep 16 16:27:45 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:45 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-930c6f49-9810-4d87-9002-c93586295eff" returned: 0 in 0.277s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-930c6f49-9810-4d87-9002-c93586295eff" released by "delete_volume" :: held 0.785s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created reservations ['c36b2406-595d-4a80-96c3-f593966244b5', '3290601a-f27d-4f60-b979-00e45044a4a1', '7bf08fc4-8e31-4d52-8baf-12f44bed9f03', 'a01accdc-5fac-41a0-bf94-ff83636be6f3'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:45 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:45 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-79826f65-b3e3-46cd-9910-b6410629a1de-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-79826f65-b3e3-46cd-9910-b6410629a1de-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-quobyte-79826f65-b3e3-46cd-9910-b6410629a1de" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-79826f65-b3e3-46cd-9910-b6410629a1de" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:45 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Deleted volume successfully. Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cfd07f-d24f-4662-919f-f3b24c6bc680]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-062d0557-2d02-41ec-a9ad-b08a86ace0fa tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-930c6f49-9810-4d87-9002-c93586295eff-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:46 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de Sep 16 16:27:46 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:46 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de" returned: 0 in 0.399s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:46 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de Sep 16 16:27:46 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:46 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-79826f65-b3e3-46cd-9910-b6410629a1de" returned: 0 in 0.276s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-79826f65-b3e3-46cd-9910-b6410629a1de" released by "delete_volume" :: held 0.732s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created reservations ['fad02ecc-7066-4a63-b4b6-c6b3c0bca0ba', '3be9817c-2b04-4ec1-9209-cd6629b9a58c', '7c25faa3-3220-4c22-a938-ec185a7fab11', '167f7231-e1c4-4d0f-9596-508a1c23a246'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:46 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:46 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-b65fe072-1855-48a9-8ed0-556dab083c69-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-b65fe072-1855-48a9-8ed0-556dab083c69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-quobyte-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-quobyte-b65fe072-1855-48a9-8ed0-556dab083c69" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-b65fe072-1855-48a9-8ed0-556dab083c69" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Deleting offline snapshot b65fe072-1855-48a9-8ed0-556dab083c69 of volume 9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] snapshot_file for this snap is: volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:27:47 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.298s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Deleted volume successfully. Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cda4e29-2876-4c32-8b00-a3c7a6a41da8]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9dc07725-bed1-4a78-b4d8-de608d918b8c tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-79826f65-b3e3-46cd-9910-b6410629a1de-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:47 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 Sep 16 16:27:47 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:47 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69" returned: 0 in 0.396s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bcce2f-9755-4391-a4c5-54c1180ae922]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:47 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b Sep 16 16:27:47 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:48 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" returned: 0 in 0.467s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:48 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 Sep 16 16:27:48 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:48 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69" returned: 0 in 0.442s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:48 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69 Sep 16 16:27:48 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:48 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b.b65fe072-1855-48a9-8ed0-556dab083c69" returned: 0 in 0.286s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-b65fe072-1855-48a9-8ed0-556dab083c69" released by "_delete_snapshot" :: held 1.757s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" released by "delete_snapshot" :: held 1.788s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:48 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created reservations ['6eefe2f9-b235-406a-9519-37fd899179a6', '29bf004d-4a9d-4e1b-8d73-c0f23d2c8040', 'fbfae94e-de5d-4046-88cc-940774d2c418', 'efcd8bd6-08c3-49fc-bf6c-42bee8ca4aa1'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Delete snapshot completed successfully. Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-de835e19-a4e1-493b-a6ee-c4864511fecd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-b65fe072-1855-48a9-8ed0-556dab083c69-delete_snapshot" released by "delete_snapshot" :: held 2.006s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "cinder-quobyte-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Flow 'volume_create_manager' (4d4183e3-23a1-4f39-9a37-67f7cd0b7df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86455d08-b058-4c05-9cbf-5bc70d14a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" acquired by "delete_volume" :: waited 0.046s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86455d08-b058-4c05-9cbf-5bc70d14a25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-672200055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca767519-f2d1-4e19-90de-b485d76f2312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa8af88a1f4026be1c51f48f44b545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:49Z,use_quota=True,user_id='bdbd047017fe4a35b6c7e4c8f7d01257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1d5afd-3f8e-43c0-961b-48a13524f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1d5afd-3f8e-43c0-961b-48a13524f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a034840-f31b-4cf6-be06-6b9587363261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a034840-f31b-4cf6-be06-6b9587363261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca767519-f2d1-4e19-90de-b485d76f2312', 'volume_name': 'volume-ca767519-f2d1-4e19-90de-b485d76f2312', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea7edcb-2d5b-491b-aec3-50b9f6e0605a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea7edcb-2d5b-491b-aec3-50b9f6e0605a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6262fe1b-0fb8-4a5a-9a62-e4c43ddcfc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:49 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Volume ca767519-f2d1-4e19-90de-b485d76f2312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca767519-f2d1-4e19-90de-b485d76f2312', 'volume_size': 1} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-672200055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca767519-f2d1-4e19-90de-b485d76f2312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa8af88a1f4026be1c51f48f44b545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:49Z,use_quota=True,user_id='bdbd047017fe4a35b6c7e4c8f7d01257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Creating volume ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:49 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdf9fe4-6bfe-41cc-a4b0-ac76e8f0daad]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:49 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 1073741824 Sep 16 16:27:49 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:49 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b Sep 16 16:27:49 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:49 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" returned: 0 in 0.408s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:49 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b Sep 16 16:27:49 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:49 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 1073741824" returned: 0 in 0.474s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:49 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 Sep 16 16:27:49 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:50 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" returned: 0 in 0.263s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-quobyte-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b" released by "delete_volume" :: held 0.795s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Created reservations ['ed127ba2-2da8-4566-b3e5-1188eb07a846', '3c6c44df-d1f6-4576-8b95-484424a9c6aa', '979c5075-e5c1-49d9-bb3c-c06dc002086c', 'e409a331-19ea-4e19-9022-59006bbf916c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:27:50 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6262fe1b-0fb8-4a5a-9a62-e4c43ddcfc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca767519-f2d1-4e19-90de-b485d76f2312', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835e5ffa-686a-4087-9a11-69d76c81b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:50 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Volume volume-ca767519-f2d1-4e19-90de-b485d76f2312 (ca767519-f2d1-4e19-90de-b485d76f2312): created successfully Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835e5ffa-686a-4087-9a11-69d76c81b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Flow 'volume_create_manager' (4d4183e3-23a1-4f39-9a37-67f7cd0b7df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:50 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a9ccfe69-1793-4a0e-abb7-3d6ae68a404a tempest-SnapshotDependencyTests-786050587 None] Created volume successfully. Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:50 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:27:50 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:50 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.281s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:27:50 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Deleted volume successfully. Sep 16 16:27:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e4fac021-7d96-4d11-9844-da04c6619bfd tempest-CreateVolumesFromSnapshotTest-1070561536 None] Lock "cinder-9f77ce0d-2c4b-48ae-b57e-8a4150d00a2b-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:27:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Creating offline snapshot f5deb4a8-bca0-4c96-8cc1-5a464f37720b of volume ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:27:51 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6619d62-0e81-44aa-88ac-ecc7d83399d6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:51 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 Sep 16 16:27:51 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:52 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312" returned: 0 in 0.386s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:52 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b 1G Sep 16 16:27:52 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:52 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b 1G" returned: 0 in 0.417s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca767519-f2d1-4e19-90de-b485d76f2312 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:52 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca767519-f2d1-4e19-90de-b485d76f2312 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b Sep 16 16:27:52 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:52 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca767519-f2d1-4e19-90de-b485d76f2312 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b" returned: 0 in 0.305s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:52 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b is being set with open permissions: ugo+rw Sep 16 16:27:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:52 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b Sep 16 16:27:52 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:53 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b" returned: 0 in 0.253s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:53 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.info Sep 16 16:27:53 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:53 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.info" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:53 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.info is being set with open permissions: ugo+rw Sep 16 16:27:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:53 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.info Sep 16 16:27:53 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:53 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.info" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:53 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e13b5b9d-dcfa-48a7-901c-5c8078bcad60 tempest-SnapshotDependencyTests-786050587 None] Create snapshot completed successfully Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Flow 'volume_create_manager' (0faf2806-630e-4fd1-b256-87e07753d660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6de7a1-6a30-4ea8-a71b-427889cb1571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6de7a1-6a30-4ea8-a71b-427889cb1571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dacacf45-fb08-4b90-a4f7-cc6dd5b96eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa8af88a1f4026be1c51f48f44b545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5deb4a8-bca0-4c96-8cc1-5a464f37720b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:27:55Z,use_quota=True,user_id='bdbd047017fe4a35b6c7e4c8f7d01257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8aa636-227e-4b70-b617-2336ded46457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8aa636-227e-4b70-b617-2336ded46457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c6e8ce-6951-484e-a548-0e4875433396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c6e8ce-6951-484e-a548-0e4875433396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dacacf45-fb08-4b90-a4f7-cc6dd5b96eea', 'volume_name': 'volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea', 'volume_size': 1, 'snapshot_id': 'f5deb4a8-bca0-4c96-8cc1-5a464f37720b'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3193b8f-78f1-459e-86f3-2d2885443bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3193b8f-78f1-459e-86f3-2d2885443bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741c8534-b4a8-45fc-8020-e079d8e7d98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:27:55 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Volume dacacf45-fb08-4b90-a4f7-cc6dd5b96eea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea', 'volume_size': 1, 'snapshot_id': 'f5deb4a8-bca0-4c96-8cc1-5a464f37720b'} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "cinder-quobyte-f5deb4a8-bca0-4c96-8cc1-5a464f37720b-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" by "_create_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-f5deb4a8-bca0-4c96-8cc1-5a464f37720b-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Creating volume dacacf45-fb08-4b90-a4f7-cc6dd5b96eea from snapshot f5deb4a8-bca0-4c96-8cc1-5a464f37720b {{(pid=86255) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "cinder-quobyte-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] snapshot: f5deb4a8-bca0-4c96-8cc1-5a464f37720b, volume: dacacf45-fb08-4b90-a4f7-cc6dd5b96eea, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbdaec9-7082-4656-bc98-bf28cbe01da7]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:55 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b Sep 16 16:27:55 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:56 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b" returned: 0 in 0.427s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca767519-f2d1-4e19-90de-b485d76f2312(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:27:56 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aefb52-e675-44c7-b354-bd017e40799e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:27:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:56 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 Sep 16 16:27:56 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:27:56 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 16 16:27:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312" returned: 0 in 0.409s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:27:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:27:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:27:56 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:27:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:27:56 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea Sep 16 16:27:56 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:02 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" returned: 0 in 6.248s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:02 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:28:02 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Converted 1024.00 MB image at 163.86 MB/s Sep 16 16:28:02 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea is being set with open permissions: ugo+rw Sep 16 16:28:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:02 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea Sep 16 16:28:02 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:03 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" returned: 0 in 0.281s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" released by "_copy_volume_from_snapshot" :: held 7.470s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-f5deb4a8-bca0-4c96-8cc1-5a464f37720b-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" released by "_create_volume_from_snapshot" :: held 7.565s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.593s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741c8534-b4a8-45fc-8020-e079d8e7d98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea', 'volume_size': 1, 'snapshot_id': 'f5deb4a8-bca0-4c96-8cc1-5a464f37720b'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cacbd0c-f63c-4c71-866b-fff3305dbc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:03 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Volume volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea (dacacf45-fb08-4b90-a4f7-cc6dd5b96eea): created successfully Sep 16 16:28:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cacbd0c-f63c-4c71-866b-fff3305dbc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:03 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Flow 'volume_create_manager' (0faf2806-630e-4fd1-b256-87e07753d660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:03 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d0957db9-41f5-4c97-9fe9-45666b573d15 tempest-SnapshotDependencyTests-786050587 None] Created volume successfully. Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "cinder-f5deb4a8-bca0-4c96-8cc1-5a464f37720b-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-f5deb4a8-bca0-4c96-8cc1-5a464f37720b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "cinder-quobyte-ca767519-f2d1-4e19-90de-b485d76f2312" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-ca767519-f2d1-4e19-90de-b485d76f2312" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "cinder-quobyte-f5deb4a8-bca0-4c96-8cc1-5a464f37720b" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-f5deb4a8-bca0-4c96-8cc1-5a464f37720b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Deleting offline snapshot f5deb4a8-bca0-4c96-8cc1-5a464f37720b of volume ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] snapshot_file for this snap is: volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbfb1df-3168-4f75-a00d-05b626db0518]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:04 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b Sep 16 16:28:04 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:04 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b" returned: 0 in 0.413s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca767519-f2d1-4e19-90de-b485d76f2312(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a6ba91-bb7b-4195-8975-919060b00423]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:04 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 Sep 16 16:28:04 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:05 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312" returned: 0 in 0.569s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:05 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b Sep 16 16:28:05 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:05 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b" returned: 0 in 0.345s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:05 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b Sep 16 16:28:05 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:05 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312.f5deb4a8-bca0-4c96-8cc1-5a464f37720b" returned: 0 in 0.286s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:05 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=98,cinder:UPDATE=139,cinder:DELETE=13,cinder:INSERT=34 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:28:05 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=145,cinder:SELECT=96,cinder:INSERT=33,cinder:DELETE=14 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-f5deb4a8-bca0-4c96-8cc1-5a464f37720b" released by "_delete_snapshot" :: held 1.734s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-ca767519-f2d1-4e19-90de-b485d76f2312" released by "delete_snapshot" :: held 1.761s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Created reservations ['608cc754-ae0f-45e2-af4c-eab8e9842076', '42214c97-7ba3-4a60-b952-6b229c9e4709', 'c6c8326d-0531-4414-874e-8ba6296b5f2c', '074b868e-a3fb-4242-82b3-0c9d1d9b7756'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:06 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Delete snapshot completed successfully. Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-ed0a3c6e-1070-4e87-a4f7-ba71f277ee01 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-f5deb4a8-bca0-4c96-8cc1-5a464f37720b-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "cinder-ca767519-f2d1-4e19-90de-b485d76f2312-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-ca767519-f2d1-4e19-90de-b485d76f2312-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "cinder-quobyte-ca767519-f2d1-4e19-90de-b485d76f2312" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-ca767519-f2d1-4e19-90de-b485d76f2312" acquired by "delete_volume" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[52426c0d-a101-41d7-8de0-983c2038ac5e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:06 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 Sep 16 16:28:06 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:06 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312" returned: 0 in 0.380s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:06 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312 Sep 16 16:28:06 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:07 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca767519-f2d1-4e19-90de-b485d76f2312" returned: 0 in 0.263s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-ca767519-f2d1-4e19-90de-b485d76f2312" released by "delete_volume" :: held 0.707s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Created reservations ['15898ccd-ef15-497d-b6e0-a20e3c282bbd', '74215e60-376e-443b-b6d3-48368315fe1c', '0a9dca04-4b8d-4b3b-940a-1924f928dceb', '55f0b196-5361-4511-b752-90d82dfc6e60'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:07 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:07 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:07 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.265s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "cinder-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Deleted volume successfully. Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6b1dc515-1247-46ed-b5fa-664150d9ae06 tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-ca767519-f2d1-4e19-90de-b485d76f2312-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "cinder-quobyte-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" acquired by "delete_volume" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e049d65-b29b-4603-b91c-0d94592533fc]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:07 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea Sep 16 16:28:07 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:08 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" returned: 0 in 0.379s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:08 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea Sep 16 16:28:08 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:08 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" returned: 0 in 0.247s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-quobyte-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea" released by "delete_volume" :: held 0.671s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Created reservations ['dbbcfbef-28e4-4d5e-a2a9-86c7282d33d9', 'c883d69b-9d55-45e2-9976-e7a728c8e1b8', 'a8393128-b6f7-48b6-88fc-85b306b3ede6', '01f146ee-c6e1-4f58-b91e-f97f7e495aad'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:08 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:08 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:08 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.291s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:08 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Deleted volume successfully. Sep 16 16:28:08 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e76fe18-bca6-44b6-891f-fe7761673bad tempest-SnapshotDependencyTests-786050587 None] Lock "cinder-dacacf45-fb08-4b90-a4f7-cc6dd5b96eea-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:18 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=23 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:28:18 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (60016a52-f53f-4467-9965-c43c7ec14d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7707def8-aadf-4bfd-943d-aabc46c825ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (bbe921aa-4390-47df-9d57-08a96ea7584f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbccb9e-016d-42e5-98b2-0c1597aadb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7707def8-aadf-4bfd-943d-aabc46c825ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353875037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:30Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e15934-f80a-4407-8b18-4493654fd924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e15934-f80a-4407-8b18-4493654fd924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95133d3c-6b80-48e4-80b6-706dc6b7beaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95133d3c-6b80-48e4-80b6-706dc6b7beaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1', 'volume_name': 'volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60974e5-1c72-4c76-a8df-ed8264522da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60974e5-1c72-4c76-a8df-ed8264522da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d44fe6-4a1d-4815-b161-968af544c597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume 0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1', 'volume_size': 1} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1353875037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:30Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Creating volume 0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:30 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccbccb9e-016d-42e5-98b2-0c1597aadb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-189745880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97774101-a377-4bae-b936-29de5cd9acf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:30Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 1073741824 Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f9e481-e7a1-46bc-b5a7-1ca38d77f0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f9e481-e7a1-46bc-b5a7-1ca38d77f0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed99194d-4fa6-41d4-ba5c-796e690575e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed99194d-4fa6-41d4-ba5c-796e690575e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97774101-a377-4bae-b936-29de5cd9acf2', 'volume_name': 'volume-97774101-a377-4bae-b936-29de5cd9acf2', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9136238b-7cdd-4249-b082-7a99940175c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9136238b-7cdd-4249-b082-7a99940175c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42da1c70-cc68-4a76-ad28-11bf662b4cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume 97774101-a377-4bae-b936-29de5cd9acf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97774101-a377-4bae-b936-29de5cd9acf2', 'volume_size': 1} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Flow 'volume_create_manager' (4677cfa1-f5de-4bb8-a108-5664bbd4641e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926a722b-fa44-41df-b11f-af2dbe4bacf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926a722b-fa44-41df-b11f-af2dbe4bacf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7164e0-f8a0-4c9b-8722-bfded4ff3c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f9482db84b4cec9a846b803b0a3d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:31Z,use_quota=True,user_id='6864dea4b2884a1f929574fc46e64931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2359f15-50ed-4511-8ef6-db056d671d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2359f15-50ed-4511-8ef6-db056d671d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5433e592-df12-4e77-958c-dd5a15110511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5433e592-df12-4e77-958c-dd5a15110511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7164e0-f8a0-4c9b-8722-bfded4ff3c68', 'volume_name': 'volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cdff7b-ddc8-4e7f-bb71-116c22c96256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4cdff7b-ddc8-4e7f-bb71-116c22c96256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645b3b99-9f7d-4243-b5ff-e98e8912aa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:30 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Volume ca7164e0-f8a0-4c9b-8722-bfded4ff3c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68', 'volume_size': 1} Sep 16 16:28:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:31 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 1073741824" returned: 0 in 0.583s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:31 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 Sep 16 16:28:31 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:31 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" returned: 0 in 0.255s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-189745880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97774101-a377-4bae-b936-29de5cd9acf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:30Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Creating volume 97774101-a377-4bae-b936-29de5cd9acf2 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:31 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d44fe6-4a1d-4815-b161-968af544c597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:31 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2 1073741824 Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e497ad-e97c-4b31-a38c-a8c3df51be4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:31 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:31 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 (0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1): created successfully Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e497ad-e97c-4b31-a38c-a8c3df51be4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (60016a52-f53f-4467-9965-c43c7ec14d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:31 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3719c9b9-4a7c-4826-a097-7774f39fe7aa tempest-CreateVolumesFromSnapshotTest-390583408 None] Created volume successfully. Sep 16 16:28:31 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2 1073741824" returned: 0 in 0.492s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:31 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2 Sep 16 16:28:31 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:32 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.280s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca7164e0-f8a0-4c9b-8722-bfded4ff3c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f9482db84b4cec9a846b803b0a3d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:31Z,use_quota=True,user_id='6864dea4b2884a1f929574fc46e64931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Creating volume ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:32 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42da1c70-cc68-4a76-ad28-11bf662b4cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97774101-a377-4bae-b936-29de5cd9acf2', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d60d488-da92-4d21-ae3c-99b0d808d733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:32 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 1073741824 Sep 16 16:28:32 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:32 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume volume-97774101-a377-4bae-b936-29de5cd9acf2 (97774101-a377-4bae-b936-29de5cd9acf2): created successfully Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d60d488-da92-4d21-ae3c-99b0d808d733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (bbe921aa-4390-47df-9d57-08a96ea7584f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9b0e406d-61fb-4a46-a32e-9d9eb15bbf94 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created volume successfully. Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:32 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 1073741824" returned: 0 in 0.491s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:32 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 Sep 16 16:28:32 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:33 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68" returned: 0 in 0.270s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.672s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645b3b99-9f7d-4243-b5ff-e98e8912aa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76339e52-ef9e-465f-b7fd-18faed160f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Creating offline snapshot 3018f5f6-a16b-4ddc-b32f-113265d6104e of volume 0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:28:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Volume volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 (ca7164e0-f8a0-4c9b-8722-bfded4ff3c68): created successfully Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76339e52-ef9e-465f-b7fd-18faed160f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Flow 'volume_create_manager' (4677cfa1-f5de-4bb8-a108-5664bbd4641e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[659c7fb0-bcb9-439a-92cf-e1b28b54a2c2]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:33 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2e250f56-9a7a-421a-9eac-5d8f827dff71 tempest-CinderUnicodeTest-949002686 None] Created volume successfully. Sep 16 16:28:33 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 Sep 16 16:28:33 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:33 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" returned: 0 in 0.445s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:33 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e 1G Sep 16 16:28:33 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (7be49d53-3483-4e09-9712-d5594e0f0e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4421e5f-4bdc-4cae-b370-f6335de5f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4421e5f-4bdc-4cae-b370-f6335de5f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836515558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8e9c24-539b-4c7b-afe2-6c55f8c91925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:34Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b39c3e-50c4-4f40-ae0b-ccc7422aaaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b39c3e-50c4-4f40-ae0b-ccc7422aaaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fff649f-bde5-4a12-83a9-8540027b490b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fff649f-bde5-4a12-83a9-8540027b490b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f8e9c24-539b-4c7b-afe2-6c55f8c91925', 'volume_name': 'volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e228460c-0d27-4988-9b6c-850dc105d0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e228460c-0d27-4988-9b6c-850dc105d0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da18ba4-5e94-44a6-818b-5c7c7fc968ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume 2f8e9c24-539b-4c7b-afe2-6c55f8c91925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925', 'volume_size': 1} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:34 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Flow 'volume_create_manager' (e1fe1671-0e13-4574-be94-9234da38c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f878b308-cb69-444a-b206-039cae52b6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e 1G" returned: 0 in 0.690s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f878b308-cb69-444a-b206-039cae52b6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb97b93c-e826-4848-b43a-aa605851d981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3d1d8fea74a6f976ea26dc94e49ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:34Z,use_quota=True,user_id='f65554ec46644cdf9db18accef25b6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f7a173d-8807-4869-b6a4-2edf76465b85),volume_type_id=6f7a173d-8807-4869-b6a4-2edf76465b85)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e Sep 16 16:28:34 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f583b452-3d96-482e-ba75-cc068f329cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f583b452-3d96-482e-ba75-cc068f329cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f0ed42-90a7-4f90-a937-4c2777657172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (fe99dcbd-4b6e-4000-9839-6e5982fb8f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37aa6e9-b24e-4eaa-96df-afe90bbfe42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37aa6e9-b24e-4eaa-96df-afe90bbfe42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1777919609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921f4f59-ef17-446a-b406-d602cdaead60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:35Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c76e46-0709-4898-aacf-a8af3877b1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c76e46-0709-4898-aacf-a8af3877b1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dd7807-0080-4e64-9dd1-a126f4e7637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dd7807-0080-4e64-9dd1-a126f4e7637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '921f4f59-ef17-446a-b406-d602cdaead60', 'volume_name': 'volume-921f4f59-ef17-446a-b406-d602cdaead60', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3231c698-02a9-4f13-87ca-2de217238b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3231c698-02a9-4f13-87ca-2de217238b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc37af42-8ce5-444a-8e06-635c36acee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume 921f4f59-ef17-446a-b406-d602cdaead60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-921f4f59-ef17-446a-b406-d602cdaead60', 'volume_size': 1} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:34 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e" returned: 0 in 0.480s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:34 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e is being set with open permissions: ugo+rw Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:34 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e Sep 16 16:28:34 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f0ed42-90a7-4f90-a937-4c2777657172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb97b93c-e826-4848-b43a-aa605851d981', 'volume_name': 'volume-bb97b93c-e826-4848-b43a-aa605851d981', 'volume_size': 1, 'image_id': '47b9142b-63e9-4641-b035-792e9ab3bcfe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47b9142b-63e9-4641-b035-792e9ab3bcfe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2deff4c41a133687e96bb3fb60bdc572', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9fc3d1d8fea74a6f976ea26dc94e49ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55e78462a5fa8e7808df4ce2595d0ec27880a3dfce0b2c9d6fac95bcffdbb755b66adbd8f28517c575c3ad4411f4060827a4c48409a82f24a6a279094fc87ed7', 'id': '47b9142b-63e9-4641-b035-792e9ab3bcfe', 'created_at': datetime.datetime(2026, 9, 16, 14, 28, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 28, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47b9142b-63e9-4641-b035-792e9ab3bcfe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f5db5c-5ff2-41d0-84ba-67d870a4f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f5db5c-5ff2-41d0-84ba-67d870a4f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7548c691-a9b8-40cb-bed5-060a20abdee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Volume bb97b93c-e826-4848-b43a-aa605851d981: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb97b93c-e826-4848-b43a-aa605851d981', 'volume_size': 1, 'image_id': '47b9142b-63e9-4641-b035-792e9ab3bcfe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47b9142b-63e9-4641-b035-792e9ab3bcfe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2deff4c41a133687e96bb3fb60bdc572', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9fc3d1d8fea74a6f976ea26dc94e49ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55e78462a5fa8e7808df4ce2595d0ec27880a3dfce0b2c9d6fac95bcffdbb755b66adbd8f28517c575c3ad4411f4060827a4c48409a82f24a6a279094fc87ed7', 'id': '47b9142b-63e9-4641-b035-792e9ab3bcfe', 'created_at': datetime.datetime(2026, 9, 16, 14, 28, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 28, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47b9142b-63e9-4641-b035-792e9ab3bcfe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 16 16:28:34 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Trying to clone bb97b93c-e826-4848-b43a-aa605851d981 from image 47b9142b-63e9-4641-b035-792e9ab3bcfe at location (None, [{'url': 'file:///opt/stack/data/glance/images/47b9142b-63e9-4641-b035-792e9ab3bcfe', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:28:35 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Image download 0.00 MB at 0.00 MB/s Sep 16 16:28:35 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e" returned: 0 in 0.341s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[956c10bc-360a-4156-8a76-d208c409ce6f]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:35 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.info Sep 16 16:28:35 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:35 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD Sep 16 16:28:35 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Flow 'volume_create_manager' (ba6a4259-1f86-47c4-8fac-28d6c6f65693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65517d78-87ad-4660-ab05-799c165e656e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65517d78-87ad-4660-ab05-799c165e656e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1260697346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c7ed15-e5b2-4634-968a-dc64df1ae8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f9482db84b4cec9a846b803b0a3d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:35Z,use_quota=True,user_id='6864dea4b2884a1f929574fc46e64931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c2103a-3014-4b02-9667-184fa506e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c2103a-3014-4b02-9667-184fa506e24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b7f3a8-5915-408c-9dd3-52d07e2c6c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b7f3a8-5915-408c-9dd3-52d07e2c6c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2c7ed15-e5b2-4634-968a-dc64df1ae8bb', 'volume_name': 'volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2452620f-06ee-44a0-973d-96c5347750da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2452620f-06ee-44a0-973d-96c5347750da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29186ec8-1e49-43d6-bbb1-96793acceccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Volume c2c7ed15-e5b2-4634-968a-dc64df1ae8bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb', 'volume_size': 1} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:35 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:35 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (cb7b7d8f-e303-4bc5-ab76-ae878e5fc69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0eb485d-ebb4-430e-a08c-d8a9946da8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.info" returned: 0 in 0.432s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:35 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.info is being set with open permissions: ugo+rw Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0eb485d-ebb4-430e-a08c-d8a9946da8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120693750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4e626a-f330-4aa6-95e3-12884346ccc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:35Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.info Sep 16 16:28:35 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e007fb4-56e0-4d29-836d-7954717a1dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e007fb4-56e0-4d29-836d-7954717a1dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f683728-7ae8-413e-bf8a-f809214e535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f683728-7ae8-413e-bf8a-f809214e535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4e626a-f330-4aa6-95e3-12884346ccc8', 'volume_name': 'volume-3e4e626a-f330-4aa6-95e3-12884346ccc8', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6795b40d-b8e4-40c0-9bcf-9003a10700b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6795b40d-b8e4-40c0-9bcf-9003a10700b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146d93b9-d06e-4cbd-87a6-5254171070a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume 3e4e626a-f330-4aa6-95e3-12884346ccc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4e626a-f330-4aa6-95e3-12884346ccc8', 'volume_size': 1} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (9409b7a7-00a3-47dd-adc6-85d12f87088b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc1ea5d-34db-473a-9a7b-c2d3223a3ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD Sep 16 16:28:35 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc1ea5d-34db-473a-9a7b-c2d3223a3ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256425627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd592f8f-0f81-492b-b6ee-0c26bc7c90b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:36Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c3100c-7ad5-4efa-980f-f13ae5a9cd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c3100c-7ad5-4efa-980f-f13ae5a9cd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ef4275-f98b-49ba-9e66-ee03c2fe66f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ef4275-f98b-49ba-9e66-ee03c2fe66f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd592f8f-0f81-492b-b6ee-0c26bc7c90b5', 'volume_name': 'volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c443cbeb-fafe-4366-b612-040906871ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c443cbeb-fafe-4366-b612-040906871ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5effaee-0796-4eec-b5cb-455f198bb99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:35 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume fd592f8f-0f81-492b-b6ee-0c26bc7c90b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5', 'volume_size': 1} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:35 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.info" returned: 0 in 0.354s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.928s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-836515558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f8e9c24-539b-4c7b-afe2-6c55f8c91925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:34Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Creating volume 2f8e9c24-539b-4c7b-afe2-6c55f8c91925 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:36 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:36 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Temporary image 47b9142b-63e9-4641-b035-792e9ab3bcfe is fetched for user f65554ec46644cdf9db18accef25b6f5. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:28:36 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 1073741824 Sep 16 16:28:36 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a1a3237a-d7e8-4e06-9cf1-3701167ef215 tempest-CreateVolumesFromSnapshotTest-390583408 None] Create snapshot completed successfully Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07efe5d-c3d1-420c-988f-992ec981b733]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (4e18e413-a094-4f4b-8a24-0e5cb8d1a819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b59096b-ff6d-4045-bb13-9c447a22c035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b59096b-ff6d-4045-bb13-9c447a22c035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119069789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98236a6c-4689-4b2e-a07b-2d2778b495dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:36Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:36 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD Sep 16 16:28:36 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66926a00-95b0-42b5-b6dd-b5be1b74c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66926a00-95b0-42b5-b6dd-b5be1b74c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea00f795-a8ef-440d-bfce-0c43456cde1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea00f795-a8ef-440d-bfce-0c43456cde1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98236a6c-4689-4b2e-a07b-2d2778b495dd', 'volume_name': 'volume-98236a6c-4689-4b2e-a07b-2d2778b495dd', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0df4a53-9767-4909-b130-f6dc093046b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0df4a53-9767-4909-b130-f6dc093046b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8c33c0-2eec-4bff-86ba-8db3576c5587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:36 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume 98236a6c-4689-4b2e-a07b-2d2778b495dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98236a6c-4689-4b2e-a07b-2d2778b495dd', 'volume_size': 1} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:36 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 1073741824" returned: 0 in 0.438s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:36 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:36 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 Sep 16 16:28:36 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:36 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD Sep 16 16:28:36 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:36 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925" returned: 0 in 0.240s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1777919609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=921f4f59-ef17-446a-b406-d602cdaead60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:35Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Creating volume 921f4f59-ef17-446a-b406-d602cdaead60 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:36 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:36 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60 1073741824 Sep 16 16:28:36 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da18ba4-5e94-44a6-818b-5c7c7fc968ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ff4db8-b390-4531-979b-b2dea3bb150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:36 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 (2f8e9c24-539b-4c7b-afe2-6c55f8c91925): created successfully Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ff4db8-b390-4531-979b-b2dea3bb150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (7be49d53-3483-4e09-9712-d5594e0f0e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d6c6e78f-36d7-4036-844f-671ab2a73ea6 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created volume successfully. Sep 16 16:28:36 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:28:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:37 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60 1073741824" returned: 0 in 0.522s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:37 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60 Sep 16 16:28:37 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (76bdff0e-ccfd-49fb-8827-3ddee2432a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54896a3f-08c7-4704-9cab-40a617fc94d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54896a3f-08c7-4704-9cab-40a617fc94d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200572563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:37Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb20ca6-3203-4c8d-aa0c-4fb2e6119594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeb20ca6-3203-4c8d-aa0c-4fb2e6119594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6352daea-9829-4708-a12d-6b6b22750999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6352daea-9829-4708-a12d-6b6b22750999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84', 'volume_name': 'volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665ba5e5-5cb5-4df5-80dc-3c2562b3f05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (665ba5e5-5cb5-4df5-80dc-3c2562b3f05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1562d18-067e-45b7-abf9-ba7284797f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume 8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84', 'volume_size': 1} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:37 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60" returned: 0 in 0.294s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.081s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1260697346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c7ed15-e5b2-4634-968a-dc64df1ae8bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f9482db84b4cec9a846b803b0a3d2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:35Z,use_quota=True,user_id='6864dea4b2884a1f929574fc46e64931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Creating volume c2c7ed15-e5b2-4634-968a-dc64df1ae8bb {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:37 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:37 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb 1073741824 Sep 16 16:28:37 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc37af42-8ce5-444a-8e06-635c36acee38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-921f4f59-ef17-446a-b406-d602cdaead60', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a81456b-fc33-4e0e-a328-48b9f0317ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume volume-921f4f59-ef17-446a-b406-d602cdaead60 (921f4f59-ef17-446a-b406-d602cdaead60): created successfully Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a81456b-fc33-4e0e-a328-48b9f0317ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (fe99dcbd-4b6e-4000-9839-6e5982fb8f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-dfe41fa7-c5f0-4e3f-bca4-d7d73fffac07 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created volume successfully. Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (f0234bcd-d488-4064-a556-4ea0e699cf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3a6f13-75cf-4e13-a61e-30ef2a33951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3a6f13-75cf-4e13-a61e-30ef2a33951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401201546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec8938e-558d-4e9a-82ed-ff133e67216d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:38Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548b309b-2b5c-46ba-9698-2537fa8e8f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548b309b-2b5c-46ba-9698-2537fa8e8f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa94468-25ab-42f7-92ec-8167db6656f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa94468-25ab-42f7-92ec-8167db6656f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dec8938e-558d-4e9a-82ed-ff133e67216d', 'volume_name': 'volume-dec8938e-558d-4e9a-82ed-ff133e67216d', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d1d790-b55a-464b-aa8e-e43308792683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d1d790-b55a-464b-aa8e-e43308792683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2950d0-d970-44bd-86a7-def489adf51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:37 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume dec8938e-558d-4e9a-82ed-ff133e67216d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dec8938e-558d-4e9a-82ed-ff133e67216d', 'volume_size': 1} Sep 16 16:28:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:38 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb 1073741824" returned: 0 in 0.578s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:38 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb Sep 16 16:28:38 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (da2e1356-97f5-40c2-a460-85825a498aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11db637c-989c-48c4-bed0-615ba6da5f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11db637c-989c-48c4-bed0-615ba6da5f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-796742766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b42756-b7af-4371-b7a1-f28b5bc9a46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:38Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a6b7f8-cf57-4fd2-99f8-b46f73c53253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a6b7f8-cf57-4fd2-99f8-b46f73c53253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e49accb-4cef-456b-90ae-6ad507b63901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e49accb-4cef-456b-90ae-6ad507b63901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b42756-b7af-4371-b7a1-f28b5bc9a46a', 'volume_name': 'volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d63adf-37c5-4bb1-91fa-6bde9e42ef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d63adf-37c5-4bb1-91fa-6bde9e42ef4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b9cd7f-2a7c-4408-8620-3b3581a2667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume f5b42756-b7af-4371-b7a1-f28b5bc9a46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a', 'volume_size': 1} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:38 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" returned: 0 in 0.317s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120693750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4e626a-f330-4aa6-95e3-12884346ccc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:35Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Creating volume 3e4e626a-f330-4aa6-95e3-12884346ccc8 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:38 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:38 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 1073741824 Sep 16 16:28:38 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29186ec8-1e49-43d6-bbb1-96793acceccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3507f7-ab21-4ac6-a318-2888a0b99311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Volume volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb (c2c7ed15-e5b2-4634-968a-dc64df1ae8bb): created successfully Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf3507f7-ab21-4ac6-a318-2888a0b99311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Flow 'volume_create_manager' (ba6a4259-1f86-47c4-8fac-28d6c6f65693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2a6a0f77-3cf2-4a01-ae6f-50cd2950ea7e tempest-CinderUnicodeTest-949002686 None] Created volume successfully. Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (f5cf348f-273e-4b8c-b165-285ee85b5636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ae41e0-72b3-46d2-951c-0c339f375c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ae41e0-72b3-46d2-951c-0c339f375c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1694973085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69536531-2ccd-4d80-b273-b690e7cc41fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:39Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2b9cca-ffc2-467a-b6b1-121200a5d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2b9cca-ffc2-467a-b6b1-121200a5d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b15ce6-f7c4-4f9e-ae3c-6f8820092848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b15ce6-f7c4-4f9e-ae3c-6f8820092848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69536531-2ccd-4d80-b273-b690e7cc41fe', 'volume_name': 'volume-69536531-2ccd-4d80-b273-b690e7cc41fe', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75f637b-c584-4c03-b333-de8f68a2b3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75f637b-c584-4c03-b333-de8f68a2b3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8b29ba-1b78-4bd2-9c3e-a6591bc48a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:38 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume 69536531-2ccd-4d80-b273-b690e7cc41fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69536531-2ccd-4d80-b273-b690e7cc41fe', 'volume_size': 1} Sep 16 16:28:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (024af95b-824b-4766-aae0-11501f2683fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06043a9-19fa-4330-99bc-7614d4fed1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:39 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d06043a9-19fa-4330-99bc-7614d4fed1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1454673053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ba6d99-5dfa-4677-afe5-8dce8f9ab700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:39Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fc7375-fa88-4a74-acdf-1e973e63eea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fc7375-fa88-4a74-acdf-1e973e63eea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941ae999-3cb1-472e-b6b1-290c72d6063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (941ae999-3cb1-472e-b6b1-290c72d6063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22ba6d99-5dfa-4677-afe5-8dce8f9ab700', 'volume_name': 'volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dc0b04-3849-4c2b-b6e3-ac6e2b1fb8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dc0b04-3849-4c2b-b6e3-ac6e2b1fb8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c26edf1-86db-4ecf-8fbe-98c85b1a1e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:39 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume 22ba6d99-5dfa-4677-afe5-8dce8f9ab700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700', 'volume_size': 1} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 1073741824" returned: 0 in 0.665s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:39 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 Sep 16 16:28:39 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:39 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8" returned: 0 in 0.326s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.755s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256425627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd592f8f-0f81-492b-b6ee-0c26bc7c90b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:36Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Creating volume fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:39 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146d93b9-d06e-4cbd-87a6-5254171070a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4e626a-f330-4aa6-95e3-12884346ccc8', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:39 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 1073741824 Sep 16 16:28:39 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ba44b0-7793-4ae9-96b5-247ed18a09c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:39 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 (3e4e626a-f330-4aa6-95e3-12884346ccc8): created successfully Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ba44b0-7793-4ae9-96b5-247ed18a09c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:39 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (cb7b7d8f-e303-4bc5-ab76-ae878e5fc69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:39 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8b14b85f-4df1-47e6-929f-9806d7e056de tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created volume successfully. Sep 16 16:28:40 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 1073741824" returned: 0 in 0.507s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:40 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 Sep 16 16:28:40 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:40 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5" returned: 0 in 0.263s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.155s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119069789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98236a6c-4689-4b2e-a07b-2d2778b495dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf48f9acfdb4da29f82b714b09d1203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:36Z,use_quota=True,user_id='daaa7a8dd0574e3281d6784243b43a35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Creating volume 98236a6c-4689-4b2e-a07b-2d2778b495dd {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:40 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:40 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd 1073741824 Sep 16 16:28:40 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5effaee-0796-4eec-b5cb-455f198bb99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e011a1-8a48-47ae-aa9c-99928eca9566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:40 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 (fd592f8f-0f81-492b-b6ee-0c26bc7c90b5): created successfully Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e011a1-8a48-47ae-aa9c-99928eca9566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (9409b7a7-00a3-47dd-adc6-85d12f87088b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e1fd7abe-15e9-47a8-9844-ef34b358e291 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created volume successfully. Sep 16 16:28:40 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd 1073741824" returned: 0 in 0.461s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:40 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd Sep 16 16:28:40 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:41 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd" returned: 0 in 0.249s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.319s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb97b93c-e826-4848-b43a-aa605851d981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3d1d8fea74a6f976ea26dc94e49ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:34Z,use_quota=True,user_id='f65554ec46644cdf9db18accef25b6f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f7a173d-8807-4869-b6a4-2edf76465b85),volume_type_id=6f7a173d-8807-4869-b6a4-2edf76465b85)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Creating volume bb97b93c-e826-4848-b43a-aa605851d981 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:41 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb8c33c0-2eec-4bff-86ba-8db3576c5587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98236a6c-4689-4b2e-a07b-2d2778b495dd', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91abe030-841f-40e8-ab78-3509085547a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:41 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 1073741824 Sep 16 16:28:41 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:41 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Volume volume-98236a6c-4689-4b2e-a07b-2d2778b495dd (98236a6c-4689-4b2e-a07b-2d2778b495dd): created successfully Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91abe030-841f-40e8-ab78-3509085547a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Flow 'volume_create_manager' (4e18e413-a094-4f4b-8a24-0e5cb8d1a819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:41 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d9fe4abe-8a71-45b4-b516-d95ef8c0faf3 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created volume successfully. Sep 16 16:28:41 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 1073741824" returned: 0 in 0.455s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:41 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 Sep 16 16:28:41 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:41 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:41 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-98236a6c-4689-4b2e-a07b-2d2778b495dd-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-98236a6c-4689-4b2e-a07b-2d2778b495dd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-quobyte-98236a6c-4689-4b2e-a07b-2d2778b495dd" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-98236a6c-4689-4b2e-a07b-2d2778b495dd" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb3eaa8-ca81-42fa-ab00-a4cd58077feb]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:41 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981" returned: 0 in 0.287s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.450s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1200572563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:37Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Creating volume 8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:42 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:42 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 1073741824 Sep 16 16:28:42 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:42 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Attempting download of 47b9142b-63e9-4641-b035-792e9ab3bcfe ((None, [{'url': 'file:///opt/stack/data/glance/images/47b9142b-63e9-4641-b035-792e9ab3bcfe', 'metadata': {}}])) to volume bb97b93c-e826-4848-b43a-aa605851d981. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.301s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 28 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:28:42 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd Sep 16 16:28:42 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba3840-2d76-4603-a0e4-6432a7236887]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47b9142b-63e9-4641-b035-792e9ab3bcfe_nf_y9yry {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:42 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47b9142b-63e9-4641-b035-792e9ab3bcfe_nf_y9yry Sep 16 16:28:42 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:42 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd" returned: 0 in 0.420s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:42 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd Sep 16 16:28:42 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:42 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_47b9142b-63e9-4641-b035-792e9ab3bcfe_nf_y9yry" returned: 0 in 0.397s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47b9142b-63e9-4641-b035-792e9ab3bcfe_nf_y9yry {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:42 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 1073741824" returned: 0 in 0.503s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:42 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 Sep 16 16:28:42 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:42 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47b9142b-63e9-4641-b035-792e9ab3bcfe_nf_y9yry Sep 16 16:28:42 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:42 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-98236a6c-4689-4b2e-a07b-2d2778b495dd" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-98236a6c-4689-4b2e-a07b-2d2778b495dd" released by "delete_volume" :: held 0.750s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created reservations ['b63c12a3-9bac-4f97-8900-ec8d409206c9', '2a9e015b-863e-4211-9046-a541c2de2971', '14e5a77a-7b89-4656-b0d0-26a606bb1119', '620111e8-402c-40c3-a3e2-c8fd95c65473'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:42 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84" returned: 0 in 0.293s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.857s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1401201546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec8938e-558d-4e9a-82ed-ff133e67216d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:38Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Creating volume dec8938e-558d-4e9a-82ed-ff133e67216d {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:42 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:42 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:42 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d 1073741824 Sep 16 16:28:42 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47b9142b-63e9-4641-b035-792e9ab3bcfe_nf_y9yry" returned: 1 in 0.408s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_47b9142b-63e9-4641-b035-792e9ab3bcfe_nf_y9yry' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daa1f7a-44c2-4e8a-8ebb-faf33cb0d433]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:42 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:42 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1562d18-067e-45b7-abf9-ba7284797f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce983b0-2faf-4bf5-ae78-9117bf83ec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:42 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 (8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84): created successfully Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce983b0-2faf-4bf5-ae78-9117bf83ec36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (76bdff0e-ccfd-49fb-8827-3ddee2432a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1c76008a-f745-4102-a905-db79d716fafc tempest-CreateVolumesFromSnapshotTest-390583408 None] Created volume successfully. Sep 16 16:28:43 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD Sep 16 16:28:43 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-quobyte-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:43 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Deleted volume successfully. Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5" acquired by "delete_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-aeb48592-6baa-4c0e-945f-1a7b285dcd2c tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-98236a6c-4689-4b2e-a07b-2d2778b495dd-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d2133-d4d3-4cbf-8808-449d795d9206]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:43 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:43 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 Sep 16 16:28:43 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:43 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d 1073741824" returned: 0 in 0.666s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:43 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD Sep 16 16:28:43 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:43 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d Sep 16 16:28:43 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:43 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5" returned: 0 in 0.454s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:43 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5 Sep 16 16:28:43 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:43 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] 47b9142b-63e9-4641-b035-792e9ab3bcfe was raw, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:43 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 Sep 16 16:28:43 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:43 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d" returned: 0 in 0.292s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.482s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-796742766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b42756-b7af-4371-b7a1-f28b5bc9a46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:38Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Creating volume f5b42756-b7af-4371-b7a1-f28b5bc9a46a {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:43 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2950d0-d970-44bd-86a7-def489adf51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dec8938e-558d-4e9a-82ed-ff133e67216d', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:43 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a 1073741824 Sep 16 16:28:43 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da888575-6753-4325-8b02-7ad8e05b5357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:43 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume volume-dec8938e-558d-4e9a-82ed-ff133e67216d (dec8938e-558d-4e9a-82ed-ff133e67216d): created successfully Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da888575-6753-4325-8b02-7ad8e05b5357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:43 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (f0234bcd-d488-4064-a556-4ea0e699cf23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f914759c-9962-432e-a849-b668e40583e8 tempest-CreateVolumesFromSnapshotTest-390583408 None] Created volume successfully. Sep 16 16:28:44 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5" returned: 0 in 0.296s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5" released by "delete_volume" :: held 0.818s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created reservations ['b9099d55-b99b-4f5e-aed1-368365254aa9', 'cb32c726-74f6-4c2c-8305-050e5c55bdbd', '5da33a8e-17ae-4d76-af2b-f58ca6af1def', 'ac2bebf5-e804-4740-89fa-5d85855f61a2'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:44 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:44 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-3e4e626a-f330-4aa6-95e3-12884346ccc8-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-3e4e626a-f330-4aa6-95e3-12884346ccc8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-quobyte-3e4e626a-f330-4aa6-95e3-12884346ccc8" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:44 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a 1073741824" returned: 0 in 0.560s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-3e4e626a-f330-4aa6-95e3-12884346ccc8" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:44 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981" returned: 0 in 0.667s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_47b9142b-63e9-4641-b035-792e9ab3bcfe_cqzqafazdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:28:44 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cff89c-ce6b-426b-95c8-e30e576a9b58]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:44 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 1G Sep 16 16:28:44 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:44 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:44 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.437s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:44 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Deleted volume successfully. Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-0358d1ab-1fb0-488c-b35f-3f5c147d502b tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-fd592f8f-0f81-492b-b6ee-0c26bc7c90b5-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:44 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 Sep 16 16:28:44 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:44 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 1G" returned: 0 in 0.398s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Downloaded image 47b9142b-63e9-4641-b035-792e9ab3bcfe ((None, [{'url': 'file:///opt/stack/data/glance/images/47b9142b-63e9-4641-b035-792e9ab3bcfe', 'metadata': {}}])) to volume bb97b93c-e826-4848-b43a-aa605851d981 successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Temporary image 47b9142b-63e9-4641-b035-792e9ab3bcfe for user f65554ec46644cdf9db18accef25b6f5 is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Marking volume bb97b93c-e826-4848-b43a-aa605851d981 as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Copying metadata from image 47b9142b-63e9-4641-b035-792e9ab3bcfe to bb97b93c-e826-4848-b43a-aa605851d981. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Creating volume glance metadata for volume bb97b93c-e826-4848-b43a-aa605851d981 backed by image 47b9142b-63e9-4641-b035-792e9ab3bcfe with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '47b9142b-63e9-4641-b035-792e9ab3bcfe', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2deff4c41a133687e96bb3fb60bdc572', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:28:44 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a" returned: 0 in 0.351s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.127s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1694973085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69536531-2ccd-4d80-b273-b690e7cc41fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:39Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Creating volume 69536531-2ccd-4d80-b273-b690e7cc41fe {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:44 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b9cd7f-2a7c-4408-8620-3b3581a2667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:44 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceffeb17-698f-42a4-94cf-408dfa0db174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:44 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe 1073741824 Sep 16 16:28:44 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8" returned: 0 in 0.470s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:45 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a (f5b42756-b7af-4371-b7a1-f28b5bc9a46a): created successfully Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceffeb17-698f-42a4-94cf-408dfa0db174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:45 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8 Sep 16 16:28:45 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (da2e1356-97f5-40c2-a460-85825a498aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-81415f1b-abaf-484f-b1b9-34e7447c6aea tempest-CreateVolumesFromSnapshotTest-390583408 None] Created volume successfully. Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7548c691-a9b8-40cb-bed5-060a20abdee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb97b93c-e826-4848-b43a-aa605851d981', 'volume_size': 1, 'image_id': '47b9142b-63e9-4641-b035-792e9ab3bcfe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/47b9142b-63e9-4641-b035-792e9ab3bcfe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2deff4c41a133687e96bb3fb60bdc572', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9fc3d1d8fea74a6f976ea26dc94e49ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55e78462a5fa8e7808df4ce2595d0ec27880a3dfce0b2c9d6fac95bcffdbb755b66adbd8f28517c575c3ad4411f4060827a4c48409a82f24a6a279094fc87ed7', 'id': '47b9142b-63e9-4641-b035-792e9ab3bcfe', 'created_at': datetime.datetime(2026, 9, 16, 14, 28, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 28, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/47b9142b-63e9-4641-b035-792e9ab3bcfe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4bd5ee-caef-4638-824a-26ce10e203b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:45 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Volume volume-bb97b93c-e826-4848-b43a-aa605851d981 (bb97b93c-e826-4848-b43a-aa605851d981): created successfully Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4bd5ee-caef-4638-824a-26ce10e203b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Flow 'volume_create_manager' (e1fe1671-0e13-4574-be94-9234da38c24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c61c9ed8-17e1-4efd-bacf-30e9e6e6af2f tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Created volume successfully. Sep 16 16:28:45 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3e4e626a-f330-4aa6-95e3-12884346ccc8" returned: 0 in 0.289s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-3e4e626a-f330-4aa6-95e3-12884346ccc8" released by "delete_volume" :: held 0.843s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created reservations ['b08b62fe-0116-4aed-aa4f-d41d97dd3b80', '3f4911a9-34ff-44eb-b5e6-8b995e0f9a93', '216e50cc-71db-4611-aaf8-451a243edd31', '36db1573-c876-4d8a-944e-600435e8fd87'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:45 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe 1073741824" returned: 0 in 0.500s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:45 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:45 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:45 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe Sep 16 16:28:45 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-921f4f59-ef17-446a-b406-d602cdaead60-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-921f4f59-ef17-446a-b406-d602cdaead60-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-quobyte-921f4f59-ef17-446a-b406-d602cdaead60" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-921f4f59-ef17-446a-b406-d602cdaead60" acquired by "delete_volume" :: waited 0.014s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Acquiring lock "cinder-bb97b93c-e826-4848-b43a-aa605851d981-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "cinder-bb97b93c-e826-4848-b43a-aa605851d981-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68ad018-77ed-4b14-ba14-4297d5a5c6ab]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:45 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.392s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Deleted volume successfully. Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9230a8fd-7d31-4b89-86f9-441788af1254 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-3e4e626a-f330-4aa6-95e3-12884346ccc8-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Acquiring lock "cinder-quobyte-bb97b93c-e826-4848-b43a-aa605851d981" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "cinder-quobyte-bb97b93c-e826-4848-b43a-aa605851d981" acquired by "delete_volume" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[203eb78f-73f1-4ae2-9d4f-bcb82554606b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:45 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe" returned: 0 in 0.471s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.739s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1454673053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22ba6d99-5dfa-4677-afe5-8dce8f9ab700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9188b87f934720b4f359247ea9bdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:39Z,use_quota=True,user_id='8d2ccf2420544f08bc5ad59aa2b48a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Creating volume 22ba6d99-5dfa-4677-afe5-8dce8f9ab700 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:45 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60 Sep 16 16:28:45 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:45 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8b29ba-1b78-4bd2-9c3e-a6591bc48a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69536531-2ccd-4d80-b273-b690e7cc41fe', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:46 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 1073741824 Sep 16 16:28:46 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1e3df0-ce62-4ccc-8173-3d712ba97cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:46 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume volume-69536531-2ccd-4d80-b273-b690e7cc41fe (69536531-2ccd-4d80-b273-b690e7cc41fe): created successfully Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1e3df0-ce62-4ccc-8173-3d712ba97cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (f5cf348f-273e-4b8c-b165-285ee85b5636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-281d45f1-ca85-48e8-afa4-08480e040dc2 tempest-CreateVolumesFromSnapshotTest-390583408 None] Created volume successfully. Sep 16 16:28:46 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 Sep 16 16:28:46 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:46 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60" returned: 0 in 0.454s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:46 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60 Sep 16 16:28:46 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:46 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981" returned: 0 in 0.405s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:46 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981 Sep 16 16:28:46 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:46 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 1073741824" returned: 0 in 0.531s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:46 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-921f4f59-ef17-446a-b406-d602cdaead60" returned: 0 in 0.282s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-921f4f59-ef17-446a-b406-d602cdaead60" released by "delete_volume" :: held 0.831s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:46 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 Sep 16 16:28:46 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:46 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bb97b93c-e826-4848-b43a-aa605851d981" returned: 0 in 0.295s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "cinder-quobyte-bb97b93c-e826-4848-b43a-aa605851d981" released by "delete_volume" :: held 0.754s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created reservations ['5e9d8ad6-db9f-4371-bab1-c6d615097012', '0845a8db-2d45-4044-b765-a9df0ae512f4', 'e14763ea-810f-4533-9672-c54c6b90362f', '8be16931-0943-4ed3-b8f0-bc0d7d619308'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Created reservations ['0a0ea92d-7e14-473e-aaf3-729e713ac0e2', '2ebca4ec-5386-4c72-a62b-a53c4b488b77', '76aa6d8b-4c69-4589-bff7-af04aa211f37', 'd578ee33-85c3-43da-88ff-2f2a8dbd5d66'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:46 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:46 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:46 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700" returned: 0 in 0.293s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.236s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c26edf1-86db-4ecf-8fbe-98c85b1a1e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2084f9c5-dc38-46a4-a4d3-792d21ab9829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Creating offline snapshot 5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db of volume c2c7ed15-e5b2-4634-968a-dc64df1ae8bb {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d0a8e2-9d66-4590-9771-ced4c40062f6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:46 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:46 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:46 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Volume volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 (22ba6d99-5dfa-4677-afe5-8dce8f9ab700): created successfully Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2084f9c5-dc38-46a4-a4d3-792d21ab9829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Flow 'volume_create_manager' (024af95b-824b-4766-aae0-11501f2683fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2ba83ad1-8159-4350-9581-e2b09b09ae8b tempest-CreateVolumesFromSnapshotTest-390583408 None] Created volume successfully. Sep 16 16:28:47 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb Sep 16 16:28:47 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:47 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.340s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Deleted volume successfully. Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b2cfe892-f127-4829-a153-23d5dec55590 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-921f4f59-ef17-446a-b406-d602cdaead60-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:47 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.323s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Deleted volume successfully. Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-394b29df-e560-4dcd-bb4e-486a3c01a0c1 tempest-VolumeAndVolumeTypeFromImageTest-288910906 None] Lock "cinder-bb97b93c-e826-4848-b43a-aa605851d981-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:47 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" returned: 0 in 0.468s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:47 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db 1G Sep 16 16:28:47 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-2f8e9c24-539b-4c7b-afe2-6c55f8c91925-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-2f8e9c24-539b-4c7b-afe2-6c55f8c91925-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-quobyte-2f8e9c24-539b-4c7b-afe2-6c55f8c91925" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-2f8e9c24-539b-4c7b-afe2-6c55f8c91925" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:47 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db 1G" returned: 0 in 0.572s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[656984d6-f04f-4316-a005-db55f676b6c5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:48 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db Sep 16 16:28:48 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-22ba6d99-5dfa-4677-afe5-8dce8f9ab700-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-22ba6d99-5dfa-4677-afe5-8dce8f9ab700-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-quobyte-22ba6d99-5dfa-4677-afe5-8dce8f9ab700" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-22ba6d99-5dfa-4677-afe5-8dce8f9ab700" acquired by "delete_volume" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:48 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 Sep 16 16:28:48 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeecc59-bcb1-496e-961e-f76113642a3a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:48 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 Sep 16 16:28:48 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:48 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db" returned: 0 in 0.432s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:48 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db is being set with open permissions: ugo+rw Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:48 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db Sep 16 16:28:48 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:48 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925" returned: 0 in 0.515s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:48 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925 Sep 16 16:28:48 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:48 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700" returned: 0 in 0.454s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:48 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700 Sep 16 16:28:48 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:48 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db" returned: 0 in 0.345s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:48 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.info Sep 16 16:28:48 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:48 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2f8e9c24-539b-4c7b-afe2-6c55f8c91925" returned: 0 in 0.355s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-2f8e9c24-539b-4c7b-afe2-6c55f8c91925" released by "delete_volume" :: held 0.957s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:48 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created reservations ['779fa3ce-0845-4f8e-a7c9-f019ab21aa6b', 'ecf7a1de-0bde-448f-8ef2-9e97ab98122a', '55ec24d3-2d74-4859-9880-85ebae5ff787', 'a3598480-4a2f-4531-a34f-040a9736870d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:49 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-22ba6d99-5dfa-4677-afe5-8dce8f9ab700" returned: 0 in 0.376s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-22ba6d99-5dfa-4677-afe5-8dce8f9ab700" released by "delete_volume" :: held 0.896s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:49 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:49 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:49 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.info" returned: 0 in 0.361s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:49 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.info is being set with open permissions: ugo+rw Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Created reservations ['94089732-cbf0-40f3-811d-be7a69474081', '6313381e-9b12-407e-8447-ddf1e50e5f7b', 'eaa35c16-6e37-4180-aacb-58399409eeee', '6c706bdc-6f61-4996-b2f3-49bec23eb5fb'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:49 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.info Sep 16 16:28:49 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:49 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:49 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-69536531-2ccd-4d80-b273-b690e7cc41fe-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-69536531-2ccd-4d80-b273-b690e7cc41fe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-quobyte-69536531-2ccd-4d80-b273-b690e7cc41fe" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-69536531-2ccd-4d80-b273-b690e7cc41fe" acquired by "delete_volume" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:49 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.info" returned: 0 in 0.427s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:49 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bf8f72-d7c5-4fbc-8886-1ee9ce27f831]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:49 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.524s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.368s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Deleted volume successfully. Sep 16 16:28:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7b3f5f1d-0f00-4ba1-a920-0b85fbfb3f5f tempest-CinderUnicodeTest-949002686 None] Create snapshot completed successfully Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4320396a-ff85-4f12-b58b-1e575d7a9d20 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-2f8e9c24-539b-4c7b-afe2-6c55f8c91925-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:49 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Deleted volume successfully. Sep 16 16:28:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1a53938-dac3-4606-869d-43e1b175e994 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-22ba6d99-5dfa-4677-afe5-8dce8f9ab700-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:49 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe Sep 16 16:28:49 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:50 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe" returned: 0 in 0.452s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:50 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe Sep 16 16:28:50 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-97774101-a377-4bae-b936-29de5cd9acf2-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-97774101-a377-4bae-b936-29de5cd9acf2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Acquiring lock "cinder-5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Acquiring lock "cinder-quobyte-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "cinder-quobyte-97774101-a377-4bae-b936-29de5cd9acf2" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-quobyte-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Acquiring lock "cinder-quobyte-5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-97774101-a377-4bae-b936-29de5cd9acf2" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-quobyte-5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Deleting offline snapshot 5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db of volume c2c7ed15-e5b2-4634-968a-dc64df1ae8bb {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] snapshot_file for this snap is: volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[135d7358-b02c-4ab6-bef6-0efb270354f9]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99a5441-d4e7-494f-be60-f499293c34e2]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:50 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-69536531-2ccd-4d80-b273-b690e7cc41fe" returned: 0 in 0.382s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-69536531-2ccd-4d80-b273-b690e7cc41fe" released by "delete_volume" :: held 0.928s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:50 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2 Sep 16 16:28:50 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:50 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db Sep 16 16:28:50 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Created reservations ['7620921a-b55a-4fbf-b33c-d149bf0094a1', 'a4e3df0b-02a4-47d7-8d3b-1a94f776ffb6', 'e7bdcaaf-159d-4799-9d6a-9af758299a16', 'ec9ba04e-e1b1-482c-9b49-1a05ab1c74c4'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:50 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:50 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-f5b42756-b7af-4371-b7a1-f28b5bc9a46a-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-f5b42756-b7af-4371-b7a1-f28b5bc9a46a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:50 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-quobyte-f5b42756-b7af-4371-b7a1-f28b5bc9a46a" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-f5b42756-b7af-4371-b7a1-f28b5bc9a46a" acquired by "delete_volume" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2" returned: 0 in 0.592s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bb314f-7ff0-497b-9dfd-2bcb863c6809]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:51 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2 Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db" returned: 0 in 0.666s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:28:51 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.413s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:51 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Deleted volume successfully. Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b69afe-1d47-4b55-a5fd-1c7ced7f483f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:51 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a Sep 16 16:28:51 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-54f71274-8802-4619-bbfa-b849ccdd274b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-69536531-2ccd-4d80-b273-b690e7cc41fe-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:51 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb Sep 16 16:28:51 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:51 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-97774101-a377-4bae-b936-29de5cd9acf2" returned: 0 in 0.510s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-quobyte-97774101-a377-4bae-b936-29de5cd9acf2" released by "delete_volume" :: held 1.182s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:51 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a" returned: 0 in 0.554s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:51 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a Sep 16 16:28:51 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Created reservations ['391bf92d-e391-453d-9c68-4ab9bbf75cd7', '425c39ef-5a8f-4741-bb67-a88b4ef8a8e9', 'ecd69ffa-d59a-4463-979d-64ba3f3b9e56', '4c461eef-d074-42fb-8d89-ea50547d5ff5'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:51 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:51 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:51 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" returned: 0 in 0.627s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:51 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db Sep 16 16:28:51 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:51 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-f5b42756-b7af-4371-b7a1-f28b5bc9a46a" returned: 0 in 0.370s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:51 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-f5b42756-b7af-4371-b7a1-f28b5bc9a46a" released by "delete_volume" :: held 1.014s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Created reservations ['2d060772-a293-4432-9a64-6476dc5b5f76', 'c4cd8d6a-8d5a-458b-8f6f-bcf4e2c90775', '726bbe40-96d9-4035-a626-21438fc5663c', 'f2347e58-d113-47c2-9976-d16995dd766e'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:52 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.351s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Deleted volume successfully. Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-315ac6a1-217d-4151-935a-8911d07fd493 tempest-CreateVolumesFromSourceVolumeTest-985437459 None] Lock "cinder-97774101-a377-4bae-b936-29de5cd9acf2-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:52 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:52 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:52 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db" returned: 0 in 0.436s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:52 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db Sep 16 16:28:52 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:52 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.323s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:52 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Deleted volume successfully. Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb.5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db" returned: 0 in 0.289s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-quobyte-5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db" released by "_delete_snapshot" :: held 2.211s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9e76e4c3-b68f-4ce6-a1ef-8cd36d3bb83f tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-f5b42756-b7af-4371-b7a1-f28b5bc9a46a-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-quobyte-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" released by "delete_snapshot" :: held 2.255s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Created reservations ['e23ee22e-337c-40ff-b17e-d18846e026ac', '7c8b0f10-6829-4a05-b02d-5a72d78306b2', '54c3634a-3764-438a-8160-20b4c6d37ee4', '512a09ad-ffa5-414b-a989-7674909ff0a1'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Delete snapshot completed successfully. Sep 16 16:28:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-846b88f3-03b1-4305-b14a-a13028a05a84 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-5be6b8b2-dce8-4976-8fd3-f57ac8c2a1db-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-dec8938e-558d-4e9a-82ed-ff133e67216d-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-dec8938e-558d-4e9a-82ed-ff133e67216d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-quobyte-dec8938e-558d-4e9a-82ed-ff133e67216d" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-dec8938e-558d-4e9a-82ed-ff133e67216d" acquired by "delete_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e3882d-59c0-4600-a153-f21836633ae5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (2f5605d8-41b0-4771-8c0e-9ba66faa2fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ffcf11-5414-4808-a6b0-f3cce3ffce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ffcf11-5414-4808-a6b0-f3cce3ffce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778505721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fae3643-0e6a-4809-9a7a-5129540fe636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:53Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b02dd54-91bc-4cda-8ad3-a3a5aab794aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b02dd54-91bc-4cda-8ad3-a3a5aab794aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209400fc-a1ed-4f4d-83ac-a495733a619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209400fc-a1ed-4f4d-83ac-a495733a619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fae3643-0e6a-4809-9a7a-5129540fe636', 'volume_name': 'volume-2fae3643-0e6a-4809-9a7a-5129540fe636', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc959d67-1fb6-4815-b29a-66ee7eac4173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc959d67-1fb6-4815-b29a-66ee7eac4173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9092985f-7b6e-47a7-99ae-403f1e448482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:53 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Volume 2fae3643-0e6a-4809-9a7a-5129540fe636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fae3643-0e6a-4809-9a7a-5129540fe636', 'volume_size': 1} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1778505721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fae3643-0e6a-4809-9a7a-5129540fe636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:53Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Creating volume 2fae3643-0e6a-4809-9a7a-5129540fe636 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:53 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:53 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d Sep 16 16:28:53 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:53 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636 1073741824 Sep 16 16:28:53 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Acquiring lock "cinder-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Lock "cinder-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Acquiring lock "cinder-quobyte-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Lock "cinder-quobyte-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" acquired by "delete_volume" :: waited 0.044s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9adf9d-2867-4259-8ebc-4ad5937780b1]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (9c3b1c90-1d62-470d-8bac-0831291f6f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a99d34-f554-4ef0-b02f-56dcf37ca474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb Sep 16 16:28:54 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:54 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a99d34-f554-4ef0-b02f-56dcf37ca474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337797741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25c7b20-cc50-49cc-aa2c-79809e6bbc70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:54Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dffc646-683c-4344-871e-4c13cab30725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dffc646-683c-4344-871e-4c13cab30725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78739e5-4d90-454b-b683-3491cff426ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78739e5-4d90-454b-b683-3491cff426ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a25c7b20-cc50-49cc-aa2c-79809e6bbc70', 'volume_name': 'volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a69e51-286b-453b-8949-e1b2be6d27cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a69e51-286b-453b-8949-e1b2be6d27cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1eb392-5477-49b8-b2cd-d4b8cbc341bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Volume a25c7b20-cc50-49cc-aa2c-79809e6bbc70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70', 'volume_size': 1} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d" returned: 0 in 0.870s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:54 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636 1073741824" returned: 0 in 0.720s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:54 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d Sep 16 16:28:54 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:54 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636 Sep 16 16:28:54 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (394cb82d-fcd2-4760-96c9-c138a124e43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0cf973-f6d5-40e3-91de-f4792964d985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe0cf973-f6d5-40e3-91de-f4792964d985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687252816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c104455-b466-4e05-8cc6-7e18a560bd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:54Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b7326b-3ad0-4a16-ba97-b41b281a653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b7326b-3ad0-4a16-ba97-b41b281a653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1182f075-7ab1-4182-86ec-0a0b6146322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1182f075-7ab1-4182-86ec-0a0b6146322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c104455-b466-4e05-8cc6-7e18a560bd3b', 'volume_name': 'volume-3c104455-b466-4e05-8cc6-7e18a560bd3b', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c0a2f6-84de-4167-ba0b-193e3cb7bb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c0a2f6-84de-4167-ba0b-193e3cb7bb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e701a536-e16f-4b2f-baf3-4b497543a516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:54 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Volume 3c104455-b466-4e05-8cc6-7e18a560bd3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c104455-b466-4e05-8cc6-7e18a560bd3b', 'volume_size': 1} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" returned: 0 in 0.712s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:54 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb Sep 16 16:28:54 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:54 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-dec8938e-558d-4e9a-82ed-ff133e67216d" returned: 0 in 0.412s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-dec8938e-558d-4e9a-82ed-ff133e67216d" released by "delete_volume" :: held 1.363s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:54 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636" returned: 0 in 0.480s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.622s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1337797741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25c7b20-cc50-49cc-aa2c-79809e6bbc70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:54Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Creating volume a25c7b20-cc50-49cc-aa2c-79809e6bbc70 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:54 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Created reservations ['41871f09-279f-4ada-af4a-e75be0528053', '93f4aef6-7750-4a1d-a668-988b65768780', '6d668965-2a3c-4885-89f7-e3d743abc279', '36bf86d1-6c5e-4469-8e54-800c5a9e23f5'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9092985f-7b6e-47a7-99ae-403f1e448482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fae3643-0e6a-4809-9a7a-5129540fe636', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:54 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 1073741824 Sep 16 16:28:54 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:54 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d6a739-71d9-4552-b20c-593fb166930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:55 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Volume volume-2fae3643-0e6a-4809-9a7a-5129540fe636 (2fae3643-0e6a-4809-9a7a-5129540fe636): created successfully Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d6a739-71d9-4552-b20c-593fb166930e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (2f5605d8-41b0-4771-8c0e-9ba66faa2fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:55 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f7198c85-9ea4-4cb4-8b53-d8972283b77a tempest-CreateVolumesFromImageTest-831930331 None] Created volume successfully. Sep 16 16:28:55 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" returned: 0 in 0.572s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Lock "cinder-quobyte-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb" released by "delete_volume" :: held 1.455s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:55 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:55 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (b126a575-ecab-4ecb-89e1-4353033b265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc645dc-1282-4b81-b6d1-e3092356c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc645dc-1282-4b81-b6d1-e3092356c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047580582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b0bf86-cebd-4ebb-9724-8f885831d8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:55Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5213224-003b-4565-b5c3-2e953fd3fc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5213224-003b-4565-b5c3-2e953fd3fc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd1c8e3-198a-48d1-858f-7d2f95911c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd1c8e3-198a-48d1-858f-7d2f95911c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b0bf86-cebd-4ebb-9724-8f885831d8cd', 'volume_name': 'volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc95b91-76a5-4f3e-a297-2a13c56632e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc95b91-76a5-4f3e-a297-2a13c56632e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640373d7-4075-46c9-8bd9-416492a5257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:55 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Volume 46b0bf86-cebd-4ebb-9724-8f885831d8cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd', 'volume_size': 1} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Created reservations ['da467c64-486d-4ce0-9075-cb083699cc7b', '46b4f443-b0c0-4d89-ac04-847c7690d2d6', '7124754e-69ab-46e0-a343-b1860bd24c4c', 'd0944bf8-4bf2-470a-b202-b5d04463d852'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:55 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.426s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:55 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Deleted volume successfully. Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b24174ff-026a-4ef7-8816-e9b83236b22b tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-dec8938e-558d-4e9a-82ed-ff133e67216d-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:55 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:55 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:55 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 1073741824" returned: 0 in 0.933s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-quobyte-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84" acquired by "delete_volume" :: waited 0.053s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (44b9e0ff-68e9-4b83-bd7d-c655ef3967e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b390d806-8681-4b6e-9840-73c45e48c5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d7ac2a-3367-481f-bc98-e4fafcba07fd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b390d806-8681-4b6e-9840-73c45e48c5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104407179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dbd1498-6a0a-46ed-b9b1-34b82da00add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:56Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa78f10a-1284-414a-874b-a7b407a3e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa78f10a-1284-414a-874b-a7b407a3e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24498fed-31aa-4fce-bdce-b0c6a40cc1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24498fed-31aa-4fce-bdce-b0c6a40cc1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dbd1498-6a0a-46ed-b9b1-34b82da00add', 'volume_name': 'volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:56 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e83c324-315b-481c-987f-ef8dd696749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:56 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e83c324-315b-481c-987f-ef8dd696749a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f316b2-048b-42f3-af13-e3e96c727bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:56 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Volume 4dbd1498-6a0a-46ed-b9b1-34b82da00add: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add', 'volume_size': 1} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Acquiring lock "cinder-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:56 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 Sep 16 16:28:56 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:56 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Acquiring lock "cinder-quobyte-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.536s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:56 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Deleted volume successfully. Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-quobyte-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68" acquired by "delete_volume" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4de3c5-f8e4-4289-8cff-c675310985b5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-84647297-2816-43c9-b388-df238eb10a5a tempest-CinderUnicodeTest-949002686 None] Lock "cinder-c2c7ed15-e5b2-4634-968a-dc64df1ae8bb-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:56 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70" returned: 0 in 0.483s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.938s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-687252816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c104455-b466-4e05-8cc6-7e18a560bd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:54Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Creating volume 3c104455-b466-4e05-8cc6-7e18a560bd3b {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:56 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:56 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 Sep 16 16:28:56 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1eb392-5477-49b8-b2cd-d4b8cbc341bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:56 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:56 devstack sudo[105248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b 1073741824 Sep 16 16:28:56 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f263e955-e94a-41a6-be17-605bfebe5382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84" returned: 0 in 0.622s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:56 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Volume volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 (a25c7b20-cc50-49cc-aa2c-79809e6bbc70): created successfully Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f263e955-e94a-41a6-be17-605bfebe5382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (9c3b1c90-1d62-470d-8bac-0831291f6f05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:56 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84 Sep 16 16:28:56 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:56 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-27ed8eee-ce77-418f-8d37-9b0e53ae0edc tempest-CreateVolumesFromImageTest-831930331 None] Created volume successfully. Sep 16 16:28:56 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68" returned: 0 in 0.591s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:56 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68 Sep 16 16:28:56 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:57 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84" returned: 0 in 0.445s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84" released by "delete_volume" :: held 1.176s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Created reservations ['599378f3-e4ad-46f7-a6c3-ccc588825ddc', '7d3ce276-9a6f-45ce-8326-5f57a5316132', '73871eda-d304-4e9e-930b-5b8873374030', '4e3e1b0d-1093-460e-87ac-baffb958ace7'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:57 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b 1073741824" returned: 0 in 0.703s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:57 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:57 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:57 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68" returned: 0 in 0.356s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-quobyte-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68" released by "delete_volume" :: held 1.044s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:57 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b Sep 16 16:28:57 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Created reservations ['66db44b8-f206-4445-b17d-395c8c7ef454', '1913d92f-5a0a-43d7-bd43-4adc1bfe2867', 'c3336a16-d452-42df-9dff-2a0e796a8d77', '59b32f65-fc54-4a34-8aa2-94ddbc13bf2a'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:57 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:57 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.356s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:57 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:57 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Deleted volume successfully. Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Flow 'volume_create_manager' (3ac9774f-8cfc-4bc3-85e9-8c2067db14b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b14c33-dd08-444e-9a3f-5723fc7f50d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:57 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b" returned: 0 in 0.343s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047580582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b0bf86-cebd-4ebb-9724-8f885831d8cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:55Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Creating volume 46b0bf86-cebd-4ebb-9724-8f885831d8cd {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:57 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b14c33-dd08-444e-9a3f-5723fc7f50d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2126838778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2c1534-c8c3-4a67-a288-c4fe3ba38223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5881aabd9bcd438b8c3956f132b04294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:58Z,use_quota=True,user_id='8a9791be922949808e1528fda3fbea3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f73cb8-9172-4256-9d71-6afca4514c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:57 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd 1073741824 Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f73cb8-9172-4256-9d71-6afca4514c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:57 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0239559-e7a3-4a5c-8753-a27ef96aee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0239559-e7a3-4a5c-8753-a27ef96aee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f2c1534-c8c3-4a67-a288-c4fe3ba38223', 'volume_name': 'volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84069115-64bc-43ab-948a-850f1272e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84069115-64bc-43ab-948a-850f1272e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792849e2-2c52-402a-9d31-45c95879278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:57 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Volume 4f2c1534-c8c3-4a67-a288-c4fe3ba38223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223', 'volume_size': 1} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c9de49f9-18c3-4604-a155-e2230472452d tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-8ab360f9-1aed-4dd2-84a2-ab5d7b65ef84-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e701a536-e16f-4b2f-baf3-4b497543a516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c104455-b466-4e05-8cc6-7e18a560bd3b', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc20f74a-0287-42b5-92e0-43c56eb3ecb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:57 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Volume volume-3c104455-b466-4e05-8cc6-7e18a560bd3b (3c104455-b466-4e05-8cc6-7e18a560bd3b): created successfully Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc20f74a-0287-42b5-92e0-43c56eb3ecb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (394cb82d-fcd2-4760-96c9-c138a124e43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:57 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a4bddf9d-fe06-43cb-95a1-03fe355cc39a tempest-CreateVolumesFromImageTest-831930331 None] Created volume successfully. Sep 16 16:28:57 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.303s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:28:57 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Deleted volume successfully. Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e01615d5-bbf8-41e9-adbf-8d4426da7138 tempest-CinderUnicodeTest-949002686 None] Lock "cinder-ca7164e0-f8a0-4c9b-8722-bfded4ff3c68-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-3018f5f6-a16b-4ddc-b32f-113265d6104e-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-3018f5f6-a16b-4ddc-b32f-113265d6104e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:57 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-quobyte-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-quobyte-3018f5f6-a16b-4ddc-b32f-113265d6104e" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-3018f5f6-a16b-4ddc-b32f-113265d6104e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Deleting offline snapshot 3018f5f6-a16b-4ddc-b32f-113265d6104e of volume 0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] snapshot_file for this snap is: volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[6358f78f-dbef-43e8-afb2-690b4cb137b7]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:58 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e Sep 16 16:28:58 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:58 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd 1073741824" returned: 0 in 0.513s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:58 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd Sep 16 16:28:58 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:58 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e" returned: 0 in 0.418s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee2b62a-5f32-44ed-b6bf-b6394df78483]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:58 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd" returned: 0 in 0.272s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.391s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1104407179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dbd1498-6a0a-46ed-b9b1-34b82da00add,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2508a5cad054e4db60770e87bcc36ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:56Z,use_quota=True,user_id='4591db62d750488198407ef09e7d1eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Creating volume 4dbd1498-6a0a-46ed-b9b1-34b82da00add {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:58 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:58 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add 1073741824 Sep 16 16:28:58 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (640373d7-4075-46c9-8bd9-416492a5257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c1ae15-41a6-4e13-b88d-5172020c0271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:58 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Volume volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd (46b0bf86-cebd-4ebb-9724-8f885831d8cd): created successfully Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c1ae15-41a6-4e13-b88d-5172020c0271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (b126a575-ecab-4ecb-89e1-4353033b265b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:58 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 Sep 16 16:28:58 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:58 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-862b4593-6edf-437f-9909-72cef20ad34b tempest-CreateVolumesFromImageTest-831930331 None] Created volume successfully. Sep 16 16:28:58 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" returned: 0 in 0.434s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:58 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e Sep 16 16:28:58 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:59 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add 1073741824" returned: 0 in 0.509s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:59 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add Sep 16 16:28:59 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:59 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e" returned: 0 in 0.461s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:59 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add" returned: 0 in 0.334s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2126838778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f2c1534-c8c3-4a67-a288-c4fe3ba38223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5881aabd9bcd438b8c3956f132b04294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:28:58Z,use_quota=True,user_id='8a9791be922949808e1528fda3fbea3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Creating volume 4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:28:59 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:28:59 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:28:59 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f316b2-048b-42f3-af13-e3e96c727bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b4ade5-5462-4311-9a6e-32c7efd7312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:28:59 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 1073741824 Sep 16 16:28:59 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:28:59 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Volume volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add (4dbd1498-6a0a-46ed-b9b1-34b82da00add): created successfully Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b4ade5-5462-4311-9a6e-32c7efd7312c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Flow 'volume_create_manager' (44b9e0ff-68e9-4b83-bd7d-c655ef3967e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:28:59 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-87d180b4-4f37-47d8-a932-8a0cb7733569 tempest-CreateVolumesFromImageTest-831930331 None] Created volume successfully. Sep 16 16:28:59 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1.3018f5f6-a16b-4ddc-b32f-113265d6104e" returned: 0 in 0.293s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-3018f5f6-a16b-4ddc-b32f-113265d6104e" released by "_delete_snapshot" :: held 1.755s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" released by "delete_snapshot" :: held 1.782s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:28:59 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Created reservations ['f126f8af-a417-4d21-b456-c3c0e4fbc8d1', '63fdad01-4662-464d-92d6-0996cb6aa11f', '477a5e7a-1810-44b9-8a9a-8408e49df37e', '768d5704-da85-4630-8c7d-d5a4288e307c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:00 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Delete snapshot completed successfully. Sep 16 16:29:00 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 1073741824" returned: 0 in 0.622s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-70df3686-06aa-48ec-9e80-94b581e75e06 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-3018f5f6-a16b-4ddc-b32f-113265d6104e-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:00 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 Sep 16 16:29:00 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "cinder-quobyte-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[17405e55-bb7d-48a7-b91e-50ecf44e1b7b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-4dbd1498-6a0a-46ed-b9b1-34b82da00add-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:00 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" returned: 0 in 0.391s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:00 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 Sep 16 16:29:00 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-4dbd1498-6a0a-46ed-b9b1-34b82da00add-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792849e2-2c52-402a-9d31-45c95879278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109097bd-73f1-4457-a9fb-a331fec4f10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:00 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Volume volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 (4f2c1534-c8c3-4a67-a288-c4fe3ba38223): created successfully Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (109097bd-73f1-4457-a9fb-a331fec4f10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Flow 'volume_create_manager' (3ac9774f-8cfc-4bc3-85e9-8c2067db14b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:00 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d353eb86-6efd-4568-9782-aa4708c8fd70 tempest-VolumeDependencyTests-1399851497 None] Created volume successfully. Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-quobyte-4dbd1498-6a0a-46ed-b9b1-34b82da00add" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-4dbd1498-6a0a-46ed-b9b1-34b82da00add" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f64fe7-342d-4482-8d57-41811f87060c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" returned: 0 in 0.531s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:00 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:00 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add Sep 16 16:29:00 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:00 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1 Sep 16 16:29:00 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:01 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" returned: 0 in 0.434s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-quobyte-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1" released by "delete_volume" :: held 1.094s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:01 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add" returned: 0 in 0.650s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Creating offline snapshot 3db358b9-1bf8-4b2e-9891-5db78da40542 of volume 4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:29:01 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add Sep 16 16:29:01 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e59bd8-a09b-47c2-9b55-c0a5d7f40dcb]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Created reservations ['4b939b5a-3c0d-476b-91a1-971cc3183320', 'b7aa74fb-7ee2-41a7-b055-9206f8a43bfe', '46a2824a-7749-44dd-8fc8-ea3cdd3225fb', '21fa8178-e2a3-4778-87d6-3352d17e3a6c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:01 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 Sep 16 16:29:01 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:01 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:01 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:01 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4dbd1498-6a0a-46ed-b9b1-34b82da00add" returned: 0 in 0.469s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-4dbd1498-6a0a-46ed-b9b1-34b82da00add" released by "delete_volume" :: held 1.210s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Created reservations ['3fe7279c-d29c-4d04-8b54-1c2ad57a7830', '3f45a8b9-df0a-49df-a41b-48daf333d825', 'a31fbdc5-f8c9-46f3-9c95-d9c36afbbacd', '93144015-a2a5-4598-b59c-5f974c4095ea'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:02 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.428s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:02 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Deleted volume successfully. Sep 16 16:29:02 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" returned: 0 in 0.697s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:02 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 1G Sep 16 16:29:02 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f57dea45-6219-402f-acd5-d0fd6fbcf0d1 tempest-CreateVolumesFromSnapshotTest-390583408 None] Lock "cinder-0c8c7f87-7ba2-4b58-aaba-d3eb8692bce1-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:02 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:02 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:02 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.346s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:02 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Deleted volume successfully. Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1d4271db-8723-405d-b1c0-9b29dafd6f4e tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-4dbd1498-6a0a-46ed-b9b1-34b82da00add-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:02 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 1G" returned: 0 in 0.663s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:02 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 Sep 16 16:29:02 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-46b0bf86-cebd-4ebb-9724-8f885831d8cd-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-46b0bf86-cebd-4ebb-9724-8f885831d8cd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-quobyte-46b0bf86-cebd-4ebb-9724-8f885831d8cd" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-46b0bf86-cebd-4ebb-9724-8f885831d8cd" acquired by "delete_volume" :: waited 0.042s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc625a9a-7172-4c9e-b8f2-838de08fec32]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:03 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542" returned: 0 in 0.472s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:03 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 is being set with open permissions: ugo+rw Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:03 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd Sep 16 16:29:03 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:03 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 Sep 16 16:29:03 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:03 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:03 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd" returned: 0 in 0.538s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542" returned: 0 in 0.408s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:03 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd Sep 16 16:29:03 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:03 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.info Sep 16 16:29:03 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:04 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-46b0bf86-cebd-4ebb-9724-8f885831d8cd" returned: 0 in 0.433s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-46b0bf86-cebd-4ebb-9724-8f885831d8cd" released by "delete_volume" :: held 1.063s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:04 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.info" returned: 0 in 0.435s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:04 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.info is being set with open permissions: ugo+rw Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Created reservations ['217b167d-c99e-4a24-9646-973686795d97', '1139d752-c706-43e3-a759-6514fb34fa34', 'a22b4f40-2774-4f6f-834f-556afdb23441', 'c52d2176-ae3f-47dd-8efd-0242655bd201'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:04 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.info Sep 16 16:29:04 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:04 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:04 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:04 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.info" returned: 0 in 0.405s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.295s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:04 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.350s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:04 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-ecfd3ee7-e4dc-4488-b3a4-a150b8a8293d tempest-VolumeDependencyTests-1399851497 None] Create snapshot completed successfully Sep 16 16:29:04 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Deleted volume successfully. Sep 16 16:29:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e45b0cc4-e27f-491f-bfc0-997cee1c915d tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-46b0bf86-cebd-4ebb-9724-8f885831d8cd-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-3c104455-b466-4e05-8cc6-7e18a560bd3b-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-3c104455-b466-4e05-8cc6-7e18a560bd3b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-quobyte-3c104455-b466-4e05-8cc6-7e18a560bd3b" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-3c104455-b466-4e05-8cc6-7e18a560bd3b" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:05 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[56294d5b-f3de-4abb-babe-b80b4b428820]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:05 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b Sep 16 16:29:05 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:06 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b" returned: 0 in 0.604s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:06 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b Sep 16 16:29:06 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:06 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3c104455-b466-4e05-8cc6-7e18a560bd3b" returned: 0 in 0.305s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-3c104455-b466-4e05-8cc6-7e18a560bd3b" released by "delete_volume" :: held 1.000s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Flow 'volume_create_manager' (c33dcdf9-caf1-49cf-959a-b5b94e971681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b196ed-fe3a-40c0-b369-11d31c3e8bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b196ed-fe3a-40c0-b369-11d31c3e8bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1147044835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b33eacaa-c5b4-4e15-8165-b4cc685c25c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5881aabd9bcd438b8c3956f132b04294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3db358b9-1bf8-4b2e-9891-5db78da40542,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:06Z,use_quota=True,user_id='8a9791be922949808e1528fda3fbea3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c182fc6-8754-4acf-8c0f-84eedb32d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c182fc6-8754-4acf-8c0f-84eedb32d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453e1e6e-9c25-4255-ab12-5fec90811073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453e1e6e-9c25-4255-ab12-5fec90811073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b33eacaa-c5b4-4e15-8165-b4cc685c25c9', 'volume_name': 'volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9', 'volume_size': 1, 'snapshot_id': '3db358b9-1bf8-4b2e-9891-5db78da40542'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fbf71c-8721-4d60-b6a4-28a27508e5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fbf71c-8721-4d60-b6a4-28a27508e5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8484ea8c-4452-46da-bb4d-a6914a60793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Volume b33eacaa-c5b4-4e15-8165-b4cc685c25c9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9', 'volume_size': 1, 'snapshot_id': '3db358b9-1bf8-4b2e-9891-5db78da40542'} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "cinder-quobyte-3db358b9-1bf8-4b2e-9891-5db78da40542-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" by "_create_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Created reservations ['b756c93b-39bf-41bd-9f07-6ef58bf67c55', '1adad926-7133-40fb-9a96-905ec0f4491f', '199fe97f-f2d7-4e2d-8999-a889980c84dd', 'e1364b57-1073-4f7f-9cdf-bfdb5a6f3a6e'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-3db358b9-1bf8-4b2e-9891-5db78da40542-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Creating volume b33eacaa-c5b4-4e15-8165-b4cc685c25c9 from snapshot 3db358b9-1bf8-4b2e-9891-5db78da40542 {{(pid=86255) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "cinder-quobyte-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] snapshot: 3db358b9-1bf8-4b2e-9891-5db78da40542, volume: b33eacaa-c5b4-4e15-8165-b4cc685c25c9, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c0e881-3231-4b20-b82d-1a58c18c3edc]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:06 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:06 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:06 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 Sep 16 16:29:06 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:07 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.282s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Deleted volume successfully. Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f6215be8-f790-42fd-baed-5b63a0c94e13 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-3c104455-b466-4e05-8cc6-7e18a560bd3b-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:07 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542" returned: 0 in 0.507s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1511e5-cc19-415f-af35-5e590190072e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:07 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 Sep 16 16:29:07 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-a25c7b20-cc50-49cc-aa2c-79809e6bbc70-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-a25c7b20-cc50-49cc-aa2c-79809e6bbc70-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:07 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" returned: 0 in 0.565s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:07 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 Sep 16 16:29:07 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-quobyte-a25c7b20-cc50-49cc-aa2c-79809e6bbc70" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-a25c7b20-cc50-49cc-aa2c-79809e6bbc70" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13fdef1-9198-4e68-a793-400450c1cf19]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:08 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 Sep 16 16:29:08 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:08 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70" returned: 0 in 0.508s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:08 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70 Sep 16 16:29:08 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:09 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a25c7b20-cc50-49cc-aa2c-79809e6bbc70" returned: 0 in 0.818s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:09 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-a25c7b20-cc50-49cc-aa2c-79809e6bbc70" released by "delete_volume" :: held 1.408s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:09 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Created reservations ['d9373ee7-cbca-4c8f-b898-f32a35351107', '0411d83b-b290-4684-99a4-4f06a1726cc6', '24924760-7b75-445a-a0cc-f412a73474cf', '1dc5e564-2363-444c-9386-c28e7fc778b1'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:09 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:09 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:10 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.436s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:10 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:10 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Deleted volume successfully. Sep 16 16:29:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-435b0ffc-b89b-4743-a3a3-20211c5af6f5 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-a25c7b20-cc50-49cc-aa2c-79809e6bbc70-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-2fae3643-0e6a-4809-9a7a-5129540fe636-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-2fae3643-0e6a-4809-9a7a-5129540fe636-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "cinder-quobyte-2fae3643-0e6a-4809-9a7a-5129540fe636" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:10 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-2fae3643-0e6a-4809-9a7a-5129540fe636" acquired by "delete_volume" :: waited 0.031s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:10 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f92608-cd1e-44a4-833a-d5ef78c44d56]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:11 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636 Sep 16 16:29:11 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Flow 'volume_create_manager' (a68bd655-5817-4b8f-ba09-345ca987dde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fb2107-f161-46fc-8ffe-d90cd4a75173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fb2107-f161-46fc-8ffe-d90cd4a75173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402544727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc51690-2595-4590-9db1-da32a2f9209a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953cb93e8d14013b7d853499e9d9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:11Z,use_quota=True,user_id='a34d945cf88f4d5291427301114a7d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ad2fb8-898f-4f8b-8d0a-8e940608ff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ad2fb8-898f-4f8b-8d0a-8e940608ff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d251b-c11c-4e9f-a046-eaba19753df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d251b-c11c-4e9f-a046-eaba19753df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc51690-2595-4590-9db1-da32a2f9209a', 'volume_name': 'volume-4bc51690-2595-4590-9db1-da32a2f9209a', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217e3597-1ecc-44fc-8c04-cd1b107e5dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (217e3597-1ecc-44fc-8c04-cd1b107e5dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a82c024-5847-42ff-9348-3975413bc9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:11 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Volume 4bc51690-2595-4590-9db1-da32a2f9209a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc51690-2595-4590-9db1-da32a2f9209a', 'volume_size': 1} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:11 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636" returned: 0 in 0.981s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:11 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636 Sep 16 16:29:11 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:12 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-2fae3643-0e6a-4809-9a7a-5129540fe636" returned: 0 in 0.621s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-quobyte-2fae3643-0e6a-4809-9a7a-5129540fe636" released by "delete_volume" :: held 1.726s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:12 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Created reservations ['1cf93995-a456-4a27-bc20-3f31ef0cbfea', 'f7f7b2e8-f57c-4bfb-9157-54f18a068259', '0c7b44a8-bc9e-4c04-af5e-31c89498f6bc', '9ab514d7-f1a6-4125-8a1a-c41ce52e3c99'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Flow 'volume_create_manager' (e7afc732-c1a7-40e4-9660-f579350452cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:13 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:13 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27aee86-9d63-4a9e-9e38-ea7257d4a0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27aee86-9d63-4a9e-9e38-ea7257d4a0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40cf840-4c5c-46fe-bd97-bb2a72aee2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2ba9fa58ce4cf2bf1fb4149d681bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:13Z,use_quota=True,user_id='12c2b7653184492ba835bd478c5b6150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c5459a-e5e5-43d3-a450-5162418522f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3c5459a-e5e5-43d3-a450-5162418522f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58b8a7a-24f7-4e05-8ab2-715639c58410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.image.glance [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Creating Keystone auth plugin from conf {{(pid=86255) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 16 16:29:13 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.688s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:13 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Deleted volume successfully. Sep 16 16:29:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-752bb686-74f2-42ed-a459-ecb731ea2e99 tempest-CreateVolumesFromImageTest-831930331 None] Lock "cinder-2fae3643-0e6a-4809-9a7a-5129540fe636-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58b8a7a-24f7-4e05-8ab2-715639c58410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c40cf840-4c5c-46fe-bd97-bb2a72aee2ef', 'volume_name': 'volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef', 'volume_size': 1, 'image_id': '643c95be-312d-49df-afe0-e07b709411ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/643c95be-312d-49df-afe0-e07b709411ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89b521eab530427df0255554b1e1676f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf2ba9fa58ce4cf2bf1fb4149d681bf1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '876b30f1e3120b88e7d2a738adf55b60810336ec28952b08ea1229516487535cdb0194676e8fd50c720f10c010ca703a33fc8003c30b93188214333bebeb1b68', 'id': '643c95be-312d-49df-afe0-e07b709411ef', 'created_at': datetime.datetime(2026, 9, 16, 14, 29, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 29, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/643c95be-312d-49df-afe0-e07b709411ef/file', 'properties': {}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6104c8-0751-4251-bee0-642b4529820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6104c8-0751-4251-bee0-642b4529820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b32f3e9-f86b-4a66-b772-759e1e092c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:14 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Volume c40cf840-4c5c-46fe-bd97-bb2a72aee2ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef', 'volume_size': 1, 'image_id': '643c95be-312d-49df-afe0-e07b709411ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/643c95be-312d-49df-afe0-e07b709411ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89b521eab530427df0255554b1e1676f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf2ba9fa58ce4cf2bf1fb4149d681bf1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '876b30f1e3120b88e7d2a738adf55b60810336ec28952b08ea1229516487535cdb0194676e8fd50c720f10c010ca703a33fc8003c30b93188214333bebeb1b68', 'id': '643c95be-312d-49df-afe0-e07b709411ef', 'created_at': datetime.datetime(2026, 9, 16, 14, 29, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 29, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/643c95be-312d-49df-afe0-e07b709411ef/file', 'properties': {}}, 'image_service': } Sep 16 16:29:14 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Trying to clone c40cf840-4c5c-46fe-bd97-bb2a72aee2ef from image 643c95be-312d-49df-afe0-e07b709411ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/643c95be-312d-49df-afe0-e07b709411ef', 'metadata': {}}]). {{(pid=86255) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 16 16:29:14 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 16 16:29:14 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Image download 0.00 MB at 0.00 MB/s Sep 16 16:29:15 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaf9f81-be87-4d97-8887-0e3d82e7e450]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:15 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD Sep 16 16:29:15 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:15 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:15 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD Sep 16 16:29:15 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:16 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD" returned: 1 in 0.614s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Temporary image 643c95be-312d-49df-afe0-e07b709411ef is fetched for user 12c2b7653184492ba835bd478c5b6150. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d552bf-8eb5-4276-97d9-b96e1d2baa21]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:16 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD Sep 16 16:29:16 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:16 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" returned: 0 in 8.975s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:29:16 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Converted 1024.00 MB image at 114.08 MB/s Sep 16 16:29:16 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 is being set with open permissions: ugo+rw Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:16 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 Sep 16 16:29:16 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:16 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD" returned: 0 in 0.565s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:17 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD Sep 16 16:29:17 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:17 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" returned: 0 in 0.265s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" released by "_copy_volume_from_snapshot" :: held 10.436s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-3db358b9-1bf8-4b2e-9891-5db78da40542-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" released by "_create_volume_from_snapshot" :: held 10.536s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.563s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.506s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402544727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc51690-2595-4590-9db1-da32a2f9209a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953cb93e8d14013b7d853499e9d9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:11Z,use_quota=True,user_id='a34d945cf88f4d5291427301114a7d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Creating volume 4bc51690-2595-4590-9db1-da32a2f9209a {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:29:17 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8484ea8c-4452-46da-bb4d-a6914a60793f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9', 'volume_size': 1, 'snapshot_id': '3db358b9-1bf8-4b2e-9891-5db78da40542'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:17 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a 1073741824 Sep 16 16:29:17 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c120dc35-1348-4e5c-83d3-4684b0dfe591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:17 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Volume volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 (b33eacaa-c5b4-4e15-8165-b4cc685c25c9): created successfully Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c120dc35-1348-4e5c-83d3-4684b0dfe591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Flow 'volume_create_manager' (c33dcdf9-caf1-49cf-959a-b5b94e971681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:17 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e6cf74c3-0b0c-488a-9df3-02878f74a495 tempest-VolumeDependencyTests-1399851497 None] Created volume successfully. Sep 16 16:29:17 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:17 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a 1073741824" returned: 0 in 0.534s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "cinder-3db358b9-1bf8-4b2e-9891-5db78da40542-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-3db358b9-1bf8-4b2e-9891-5db78da40542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "cinder-quobyte-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "cinder-quobyte-3db358b9-1bf8-4b2e-9891-5db78da40542" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-3db358b9-1bf8-4b2e-9891-5db78da40542" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Deleting offline snapshot 3db358b9-1bf8-4b2e-9891-5db78da40542 of volume 4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:29:17 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a Sep 16 16:29:17 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] snapshot_file for this snap is: volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d87181-de63-4c1c-bcb2-b3e28a48d6af]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:18 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 Sep 16 16:29:18 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:18 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a" returned: 0 in 0.357s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40cf840-4c5c-46fe-bd97-bb2a72aee2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf2ba9fa58ce4cf2bf1fb4149d681bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:13Z,use_quota=True,user_id='12c2b7653184492ba835bd478c5b6150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Creating volume c40cf840-4c5c-46fe-bd97-bb2a72aee2ef {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:29:18 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a82c024-5847-42ff-9348-3975413bc9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc51690-2595-4590-9db1-da32a2f9209a', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:18 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef 1073741824 Sep 16 16:29:18 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d56e0f-9908-4df9-94a2-1b210471d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:18 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Volume volume-4bc51690-2595-4590-9db1-da32a2f9209a (4bc51690-2595-4590-9db1-da32a2f9209a): created successfully Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d56e0f-9908-4df9-94a2-1b210471d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Flow 'volume_create_manager' (a68bd655-5817-4b8f-ba09-345ca987dde7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e3f4c9d3-2be6-4c5a-914a-fdb718da1dd1 tempest-ProjectReaderTests-322740778 None] Created volume successfully. Sep 16 16:29:18 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542" returned: 0 in 0.458s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b49073-4985-4b28-affc-f7daf1c72d99]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:18 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 Sep 16 16:29:18 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:18 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef 1073741824" returned: 0 in 0.578s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:18 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef Sep 16 16:29:18 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:19 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" returned: 0 in 0.733s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:19 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef" returned: 0 in 0.340s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:19 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 Sep 16 16:29:19 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Attempting download of 643c95be-312d-49df-afe0-e07b709411ef ((None, [{'url': 'file:///opt/stack/data/glance/images/643c95be-312d-49df-afe0-e07b709411ef', 'metadata': {}}])) to volume c40cf840-4c5c-46fe-bd97-bb2a72aee2ef. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f96e54-def4-409a-b409-06762416af80]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_643c95be-312d-49df-afe0-e07b709411ef_i1uslnc9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:19 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_643c95be-312d-49df-afe0-e07b709411ef_i1uslnc9 Sep 16 16:29:19 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:19 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542" returned: 0 in 0.438s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Acquiring lock "cinder-4bc51690-2595-4590-9db1-da32a2f9209a-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:19 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542 Sep 16 16:29:19 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Lock "cinder-4bc51690-2595-4590-9db1-da32a2f9209a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Acquiring lock "cinder-quobyte-4bc51690-2595-4590-9db1-da32a2f9209a" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:19 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_643c95be-312d-49df-afe0-e07b709411ef_i1uslnc9" returned: 0 in 0.469s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_643c95be-312d-49df-afe0-e07b709411ef_i1uslnc9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Lock "cinder-quobyte-4bc51690-2595-4590-9db1-da32a2f9209a" acquired by "delete_volume" :: waited 0.055s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea387d52-dd85-471c-8242-ab17aacbadad]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:19 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223.3db358b9-1bf8-4b2e-9891-5db78da40542" returned: 0 in 0.372s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:19 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_643c95be-312d-49df-afe0-e07b709411ef_i1uslnc9 Sep 16 16:29:19 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:19 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a Sep 16 16:29:19 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-3db358b9-1bf8-4b2e-9891-5db78da40542" released by "_delete_snapshot" :: held 2.173s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" released by "delete_snapshot" :: held 2.198s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Created reservations ['de10b886-eff8-413c-b4eb-ff574d723617', '07824157-5ea4-4e90-9510-d790dc601b08', '9073e767-b63c-4f5e-bcf5-d646d57af7ab', 'e4dfa9ac-9b6b-43b5-b345-2b822b11ca3d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:20 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Delete snapshot completed successfully. Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d8aa82a0-a598-4276-9fe6-8ef5a0feae25 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-3db358b9-1bf8-4b2e-9891-5db78da40542-delete_snapshot" released by "delete_snapshot" :: held 2.435s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:20 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_643c95be-312d-49df-afe0-e07b709411ef_i1uslnc9" returned: 1 in 0.527s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_643c95be-312d-49df-afe0-e07b709411ef_i1uslnc9' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f71bc2-6eb9-4908-b2b6-44b35f5c3d88]: (4, 'raw') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:20 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a" returned: 0 in 0.557s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:20 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a Sep 16 16:29:20 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:20 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD Sep 16 16:29:20 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:20 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:20 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4bc51690-2595-4590-9db1-da32a2f9209a" returned: 0 in 0.325s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Lock "cinder-quobyte-4bc51690-2595-4590-9db1-da32a2f9209a" released by "delete_volume" :: held 0.969s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Created reservations ['5dda770a-8dc8-4f53-89a0-5dcfbf9d2ccd', '7511a110-38c9-4801-97a4-60a57b1f3e16', '711b9ab9-8f62-4e84-9a3b-60ad61e80958', '59191e48-c0f3-4628-9946-ad3a895a1bf1'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:20 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD Sep 16 16:29:20 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:21 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:21 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "cinder-4f2c1534-c8c3-4a67-a288-c4fe3ba38223-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-4f2c1534-c8c3-4a67-a288-c4fe3ba38223-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "cinder-quobyte-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:21 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD" returned: 1 in 0.511s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] 643c95be-312d-49df-afe0-e07b709411ef was raw, converting to qcow2 {{(pid=86255) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff67b895-6017-4fec-a02e-95b872f86c28]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:21 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef Sep 16 16:29:21 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:21 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.344s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:21 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Deleted volume successfully. Sep 16 16:29:21 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2c2645e5-50b5-4a68-87d1-947fa0259846 tempest-ProjectReaderTests-322740778 None] Lock "cinder-4bc51690-2595-4590-9db1-da32a2f9209a-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:21 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:21 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" returned: 0 in 0.467s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:21 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223 Sep 16 16:29:21 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:21 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef" returned: 0 in 0.603s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_643c95be-312d-49df-afe0-e07b709411ef_rhxkh1avdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:29:21 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 16:29:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:21 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef 1G Sep 16 16:29:21 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:22 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" returned: 0 in 0.352s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-4f2c1534-c8c3-4a67-a288-c4fe3ba38223" released by "delete_volume" :: held 0.922s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Created reservations ['e7b12ed8-5140-4c0d-bedf-78b5e6bb39a4', '1d1dbbcc-512c-49e1-b662-c35eca0de1ab', '1880bad9-7185-4f01-abc8-da0ab13eb7b0', 'e6501dfa-e608-4ac1-8a24-d75a1afd9452'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:22 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:22 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:22 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef 1G" returned: 0 in 0.536s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Downloaded image 643c95be-312d-49df-afe0-e07b709411ef ((None, [{'url': 'file:///opt/stack/data/glance/images/643c95be-312d-49df-afe0-e07b709411ef', 'metadata': {}}])) to volume c40cf840-4c5c-46fe-bd97-bb2a72aee2ef successfully. {{(pid=86255) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Temporary image 643c95be-312d-49df-afe0-e07b709411ef for user 12c2b7653184492ba835bd478c5b6150 is deleted. {{(pid=86255) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.volume_utils [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Marking volume c40cf840-4c5c-46fe-bd97-bb2a72aee2ef as bootable. {{(pid=86255) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Copying metadata from image 643c95be-312d-49df-afe0-e07b709411ef to c40cf840-4c5c-46fe-bd97-bb2a72aee2ef. {{(pid=86255) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Creating volume glance metadata for volume c40cf840-4c5c-46fe-bd97-bb2a72aee2ef backed by image 643c95be-312d-49df-afe0-e07b709411ef with: {'image_id': '643c95be-312d-49df-afe0-e07b709411ef', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '89b521eab530427df0255554b1e1676f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86255) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b32f3e9-f86b-4a66-b772-759e1e092c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef', 'volume_size': 1, 'image_id': '643c95be-312d-49df-afe0-e07b709411ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/643c95be-312d-49df-afe0-e07b709411ef', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89b521eab530427df0255554b1e1676f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bf2ba9fa58ce4cf2bf1fb4149d681bf1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '876b30f1e3120b88e7d2a738adf55b60810336ec28952b08ea1229516487535cdb0194676e8fd50c720f10c010ca703a33fc8003c30b93188214333bebeb1b68', 'id': '643c95be-312d-49df-afe0-e07b709411ef', 'created_at': datetime.datetime(2026, 9, 16, 14, 29, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 16, 14, 29, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/643c95be-312d-49df-afe0-e07b709411ef/file', 'properties': {}}, 'image_service': }' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2816fc-3224-463f-b923-95e2c3880493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:22 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Volume volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef (c40cf840-4c5c-46fe-bd97-bb2a72aee2ef): created successfully Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2816fc-3224-463f-b923-95e2c3880493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Flow 'volume_create_manager' (e7afc732-c1a7-40e4-9660-f579350452cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-345bb5f7-0cab-4a8e-8e96-9d9e67ac4837 tempest-VolumeImageDependencyTests-1816446236 None] Created volume successfully. Sep 16 16:29:22 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.414s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Deleted volume successfully. Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c8ff5930-ae91-45ab-ac69-e3bf05edd0f7 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-4f2c1534-c8c3-4a67-a288-c4fe3ba38223-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Flow 'volume_create_manager' (b0e2443b-c2b2-4b49-b5b5-a502a1bba83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765369a2-bf87-489f-b0f1-72cee2ad9f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765369a2-bf87-489f-b0f1-72cee2ad9f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145479097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84114a76-5cf1-4941-be94-daf57b428da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953cb93e8d14013b7d853499e9d9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:23Z,use_quota=True,user_id='a34d945cf88f4d5291427301114a7d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdf8f1b-3e67-461a-abe5-d3e854e5ef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdf8f1b-3e67-461a-abe5-d3e854e5ef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f742dd3e-85b4-4040-b1fb-fd639016cf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f742dd3e-85b4-4040-b1fb-fd639016cf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84114a76-5cf1-4941-be94-daf57b428da7', 'volume_name': 'volume-84114a76-5cf1-4941-be94-daf57b428da7', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3c6bf9-a16e-41ce-99b3-a6bb1a6b0954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3c6bf9-a16e-41ce-99b3-a6bb1a6b0954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed8e08d-3762-42ec-805f-b3d8b34dc55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:22 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Volume 84114a76-5cf1-4941-be94-daf57b428da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84114a76-5cf1-4941-be94-daf57b428da7', 'volume_size': 1} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145479097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84114a76-5cf1-4941-be94-daf57b428da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953cb93e8d14013b7d853499e9d9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:23Z,use_quota=True,user_id='a34d945cf88f4d5291427301114a7d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Creating volume 84114a76-5cf1-4941-be94-daf57b428da7 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:29:22 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:29:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:23 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7 1073741824 Sep 16 16:29:23 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "cinder-b33eacaa-c5b4-4e15-8165-b4cc685c25c9-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-b33eacaa-c5b4-4e15-8165-b4cc685c25c9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "cinder-quobyte-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b866e5d2-b878-435e-ad29-54461cf3ff2c]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:23 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7 1073741824" returned: 0 in 0.669s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:23 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 Sep 16 16:29:23 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:23 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7 Sep 16 16:29:23 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Acquiring lock "cinder-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Lock "cinder-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Acquiring lock "cinder-quobyte-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Lock "cinder-quobyte-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a8f34d-8f98-40d4-b6c6-81e25584ae97]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:24 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef Sep 16 16:29:24 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:24 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7" returned: 0 in 0.424s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:24 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed8e08d-3762-42ec-805f-b3d8b34dc55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84114a76-5cf1-4941-be94-daf57b428da7', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6a3e8d-633e-455a-ab92-2299281c31e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" returned: 0 in 0.605s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:24 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Volume volume-84114a76-5cf1-4941-be94-daf57b428da7 (84114a76-5cf1-4941-be94-daf57b428da7): created successfully Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6a3e8d-633e-455a-ab92-2299281c31e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Flow 'volume_create_manager' (b0e2443b-c2b2-4b49-b5b5-a502a1bba83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:24 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9 Sep 16 16:29:24 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:24 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e7f7c12e-24f5-446c-9d30-323b9e073443 tempest-ProjectReaderTests-322740778 None] Created volume successfully. Sep 16 16:29:24 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef" returned: 0 in 0.487s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:24 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef Sep 16 16:29:24 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:24 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" returned: 0 in 0.349s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-quobyte-b33eacaa-c5b4-4e15-8165-b4cc685c25c9" released by "delete_volume" :: held 1.018s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Created reservations ['ee762846-1977-45d8-be67-6f6759760d1e', '45b28e60-3a21-4bfb-9b3e-30ada33f00ca', '26b3ecbe-fe9b-4f2a-ab0d-8bb1dbe95ed0', '9b25578c-28f5-47ad-85bf-1a128888a448'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:24 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:24 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:24 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef" returned: 0 in 0.348s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Lock "cinder-quobyte-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef" released by "delete_volume" :: held 0.918s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Created reservations ['932c60c1-34b9-4332-b7bd-bf7ac2f2c7e8', '95e2bf96-7cb8-497c-b83e-8cb69094ea23', '20541cc5-3340-4990-aa50-a74ddeaee9d5', '460afa3b-c748-44b8-b42b-7162ad77abdb'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Acquiring lock "cinder-84114a76-5cf1-4941-be94-daf57b428da7-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Lock "cinder-84114a76-5cf1-4941-be94-daf57b428da7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:25 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:25 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Acquiring lock "cinder-quobyte-84114a76-5cf1-4941-be94-daf57b428da7" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Lock "cinder-quobyte-84114a76-5cf1-4941-be94-daf57b428da7" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bf767a-e8af-4687-b08d-9c78c7d6f1ea]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:25 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.507s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:25 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Deleted volume successfully. Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-351c1d71-6629-4d7f-836f-482862fe3e31 tempest-VolumeDependencyTests-1399851497 None] Lock "cinder-b33eacaa-c5b4-4e15-8165-b4cc685c25c9-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:25 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7 Sep 16 16:29:25 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:25 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.446s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:25 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Deleted volume successfully. Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4a3f3745-787a-4de3-b329-e3e7aaa324d1 tempest-VolumeImageDependencyTests-1816446236 None] Lock "cinder-c40cf840-4c5c-46fe-bd97-bb2a72aee2ef-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:25 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7" returned: 0 in 0.576s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:25 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7 Sep 16 16:29:25 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:26 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-84114a76-5cf1-4941-be94-daf57b428da7" returned: 0 in 0.343s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Lock "cinder-quobyte-84114a76-5cf1-4941-be94-daf57b428da7" released by "delete_volume" :: held 1.003s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Created reservations ['28aeaadf-8adb-43e4-8344-511fccb6bc8b', 'f3f3a21d-904a-445c-85bf-9102a6f13879', 'e4ab5cb6-1be2-43f4-8574-eb13e0e3b3b1', '5520d551-83ff-4b96-a2ed-8809644297b0'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:26 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:26 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:26 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.405s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:26 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Deleted volume successfully. Sep 16 16:29:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3623a219-2ffa-41bc-89fc-7d489f2e2b6d tempest-ProjectReaderTests-322740778 None] Lock "cinder-84114a76-5cf1-4941-be94-daf57b428da7-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Flow 'volume_create_manager' (095c3975-6f48-4fdd-a1b5-e88d9cda23f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fdbbd4c-92cc-479f-9144-5ed6fe978142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fdbbd4c-92cc-479f-9144-5ed6fe978142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866441689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0035bf90-e0aa-4871-8a67-3a738570c5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953cb93e8d14013b7d853499e9d9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:28Z,use_quota=True,user_id='a34d945cf88f4d5291427301114a7d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f79c55-2287-4847-a113-45e53632b324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f79c55-2287-4847-a113-45e53632b324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8966877e-1693-49be-892a-11f43fed1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8966877e-1693-49be-892a-11f43fed1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0035bf90-e0aa-4871-8a67-3a738570c5a3', 'volume_name': 'volume-0035bf90-e0aa-4871-8a67-3a738570c5a3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84369100-caab-4cd6-9d6a-135df9328802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84369100-caab-4cd6-9d6a-135df9328802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d17abe8-44be-43da-904e-f6f7c4252d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:28 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Volume 0035bf90-e0aa-4871-8a67-3a738570c5a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0035bf90-e0aa-4871-8a67-3a738570c5a3', 'volume_size': 1} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-866441689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0035bf90-e0aa-4871-8a67-3a738570c5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953cb93e8d14013b7d853499e9d9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:28Z,use_quota=True,user_id='a34d945cf88f4d5291427301114a7d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Creating volume 0035bf90-e0aa-4871-8a67-3a738570c5a3 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:29:28 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:28 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 1073741824 Sep 16 16:29:28 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:28 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 1073741824" returned: 0 in 0.674s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=216,cinder:UPDATE=291,cinder:INSERT=78,cinder:DELETE=24 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:29:28 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=309,cinder:SELECT=217,cinder:INSERT=81,cinder:DELETE=29 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:29:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:29 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 Sep 16 16:29:29 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:29 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3" returned: 0 in 0.340s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:29:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d17abe8-44be-43da-904e-f6f7c4252d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0035bf90-e0aa-4871-8a67-3a738570c5a3', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b677d2b-ba31-4703-ac86-96a8b47877a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:29 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Volume volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 (0035bf90-e0aa-4871-8a67-3a738570c5a3): created successfully Sep 16 16:29:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b677d2b-ba31-4703-ac86-96a8b47877a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:29 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Flow 'volume_create_manager' (095c3975-6f48-4fdd-a1b5-e88d9cda23f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-93b9a1f5-4c29-4bcc-a0e4-a7b19bc4e7a5 tempest-ProjectReaderTests-322740778 None] Created volume successfully. Sep 16 16:29:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Acquiring lock "cinder-0035bf90-e0aa-4871-8a67-3a738570c5a3-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Lock "cinder-0035bf90-e0aa-4871-8a67-3a738570c5a3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Acquiring lock "cinder-quobyte-0035bf90-e0aa-4871-8a67-3a738570c5a3" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Lock "cinder-quobyte-0035bf90-e0aa-4871-8a67-3a738570c5a3" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:30 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf44e5e-abe4-405d-ad83-78ce6af9625f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:30 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 Sep 16 16:29:30 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:31 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3" returned: 0 in 0.577s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:31 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3 Sep 16 16:29:31 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:31 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-0035bf90-e0aa-4871-8a67-3a738570c5a3" returned: 0 in 0.351s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Lock "cinder-quobyte-0035bf90-e0aa-4871-8a67-3a738570c5a3" released by "delete_volume" :: held 1.000s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Created reservations ['87249d2e-138a-4194-be97-441a1f3e88e3', 'c3e53467-db28-4350-a462-07c19b66b99a', '8081395c-0044-4018-8deb-b99d36dc69f3', 'cd34e839-f36e-4363-a927-39704a1e168b'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:31 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:31 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:32 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.415s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Deleted volume successfully. Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a90ff3e-2456-4366-a6ba-dde7bff8e7fc tempest-ProjectAdminTests-252929606 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9149932861328, 'free_capacity_gb': 1775.9149932861328, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86255) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-4616a573-955d-4eb4-b23b-ca59964601a5 tempest-ProjectReaderTests-322740778 None] Lock "cinder-0035bf90-e0aa-4871-8a67-3a738570c5a3-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (12abaf99-b75f-48bb-b9c5-5f812a8ebc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23459631-eedb-47c3-a35c-087e92fdb3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23459631-eedb-47c3-a35c-087e92fdb3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148893519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda87e87-6567-4e96-ab39-9e8005ce59ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:33Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3037b69-8e62-44f9-82db-c7ae7bf31ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3037b69-8e62-44f9-82db-c7ae7bf31ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bcd170-a291-4140-b791-a7581760674a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bcd170-a291-4140-b791-a7581760674a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bda87e87-6567-4e96-ab39-9e8005ce59ff', 'volume_name': 'volume-bda87e87-6567-4e96-ab39-9e8005ce59ff', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c15683-1289-4f78-9945-0f52f222e2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c15683-1289-4f78-9945-0f52f222e2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c48851-304a-4494-8c12-f147864e4dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Volume bda87e87-6567-4e96-ab39-9e8005ce59ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bda87e87-6567-4e96-ab39-9e8005ce59ff', 'volume_size': 1} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148893519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda87e87-6567-4e96-ab39-9e8005ce59ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:33Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Creating volume bda87e87-6567-4e96-ab39-9e8005ce59ff {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:29:33 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:33 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff 1073741824 Sep 16 16:29:33 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Flow 'volume_create_manager' (85961776-5899-4714-9b3a-e5ebcb1591c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a6ed7e8-411a-4b32-a201-66f7b764aa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a6ed7e8-411a-4b32-a201-66f7b764aa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1624574554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3230d208-b2b6-48d4-87c7-9fe08ce3736d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953cb93e8d14013b7d853499e9d9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:33Z,use_quota=True,user_id='a34d945cf88f4d5291427301114a7d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039b57ec-6f4b-46d2-8c63-fe45ad259235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039b57ec-6f4b-46d2-8c63-fe45ad259235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b52df3c-88f4-4015-881f-6dbf99a96f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b52df3c-88f4-4015-881f-6dbf99a96f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3230d208-b2b6-48d4-87c7-9fe08ce3736d', 'volume_name': 'volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a5cd7d-01fd-4c29-a16d-3c8b488e2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a5cd7d-01fd-4c29-a16d-3c8b488e2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907f9e33-2b5a-4143-bd91-6b0ffaa4f1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Volume 3230d208-b2b6-48d4-87c7-9fe08ce3736d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d', 'volume_size': 1} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:33 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff 1073741824" returned: 0 in 0.575s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:33 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff Sep 16 16:29:33 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:33 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff" returned: 0 in 0.318s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1624574554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3230d208-b2b6-48d4-87c7-9fe08ce3736d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5953cb93e8d14013b7d853499e9d9af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:33Z,use_quota=True,user_id='a34d945cf88f4d5291427301114a7d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Creating volume 3230d208-b2b6-48d4-87c7-9fe08ce3736d {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:29:33 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:29:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c48851-304a-4494-8c12-f147864e4dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bda87e87-6567-4e96-ab39-9e8005ce59ff', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b702cc-0979-468f-a338-780dbfc946d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:34 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d 1073741824 Sep 16 16:29:34 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Volume volume-bda87e87-6567-4e96-ab39-9e8005ce59ff (bda87e87-6567-4e96-ab39-9e8005ce59ff): created successfully Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b702cc-0979-468f-a338-780dbfc946d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (12abaf99-b75f-48bb-b9c5-5f812a8ebc66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:34 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9ff1378e-24e5-492d-884f-7684b18e3aaa tempest-ProjectMemberTests-954186186 None] Created volume successfully. Sep 16 16:29:34 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d 1073741824" returned: 0 in 0.564s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:34 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d Sep 16 16:29:34 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:34 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d" returned: 0 in 0.272s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907f9e33-2b5a-4143-bd91-6b0ffaa4f1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4ffa1b-aaff-45f9-8824-5378519fedd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:34 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Volume volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d (3230d208-b2b6-48d4-87c7-9fe08ce3736d): created successfully Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4ffa1b-aaff-45f9-8824-5378519fedd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:34 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Flow 'volume_create_manager' (85961776-5899-4714-9b3a-e5ebcb1591c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:34 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-df17a540-bf56-4f64-9612-ff0e3d324e58 tempest-ProjectReaderTests-322740778 None] Created volume successfully. Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Acquiring lock "cinder-3230d208-b2b6-48d4-87c7-9fe08ce3736d-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Lock "cinder-3230d208-b2b6-48d4-87c7-9fe08ce3736d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Creating offline snapshot 6fde6afd-08ec-4cd8-af42-10b8e4b7075b of volume bda87e87-6567-4e96-ab39-9e8005ce59ff {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3af55f1-415e-48b1-ac1a-db7960d47302]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Acquiring lock "cinder-quobyte-3230d208-b2b6-48d4-87c7-9fe08ce3736d" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Lock "cinder-quobyte-3230d208-b2b6-48d4-87c7-9fe08ce3736d" acquired by "delete_volume" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbdc145-be06-46c3-9f9c-af4eb8825344]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:35 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff Sep 16 16:29:35 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:35 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d Sep 16 16:29:35 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:36 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff" returned: 0 in 0.464s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:36 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b 1G Sep 16 16:29:36 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:36 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d" returned: 0 in 0.477s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:36 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d Sep 16 16:29:36 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:36 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-3230d208-b2b6-48d4-87c7-9fe08ce3736d" returned: 0 in 0.343s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Lock "cinder-quobyte-3230d208-b2b6-48d4-87c7-9fe08ce3736d" released by "delete_volume" :: held 0.892s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:36 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b 1G" returned: 0 in 0.535s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bda87e87-6567-4e96-ab39-9e8005ce59ff -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Created reservations ['d3852a92-0bbe-4ecb-b994-a897eb45d302', 'f053d8e3-c575-465b-9d76-5d958f2ad751', 'fac8ec20-1c2e-4258-b177-3827e2f49a59', '334d0bf3-1dfa-477f-a5b2-3867b2444619'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:36 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bda87e87-6567-4e96-ab39-9e8005ce59ff -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b Sep 16 16:29:36 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:36 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:36 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:37 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bda87e87-6567-4e96-ab39-9e8005ce59ff -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b" returned: 0 in 0.414s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:37 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b is being set with open permissions: ugo+rw Sep 16 16:29:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:37 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b Sep 16 16:29:37 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:37 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.334s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:37 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:37 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Deleted volume successfully. Sep 16 16:29:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c2fd6d92-7fdf-4637-a10d-b94cf26d7c04 tempest-ProjectReaderTests-322740778 None] Lock "cinder-3230d208-b2b6-48d4-87c7-9fe08ce3736d-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:37 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b" returned: 0 in 0.299s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:37 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.info Sep 16 16:29:37 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:37 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.info" returned: 0 in 0.296s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:37 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.info is being set with open permissions: ugo+rw Sep 16 16:29:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:37 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.info Sep 16 16:29:37 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:38 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.info" returned: 0 in 0.329s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.464s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-fd180d7c-a096-4a76-87c5-80b339673a5b tempest-ProjectMemberTests-954186186 None] Create snapshot completed successfully Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-6fde6afd-08ec-4cd8-af42-10b8e4b7075b-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Lock "cinder-6fde6afd-08ec-4cd8-af42-10b8e4b7075b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-bda87e87-6567-4e96-ab39-9e8005ce59ff" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-bda87e87-6567-4e96-ab39-9e8005ce59ff" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-6fde6afd-08ec-4cd8-af42-10b8e4b7075b" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-6fde6afd-08ec-4cd8-af42-10b8e4b7075b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Deleting offline snapshot 6fde6afd-08ec-4cd8-af42-10b8e4b7075b of volume bda87e87-6567-4e96-ab39-9e8005ce59ff {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] snapshot_file for this snap is: volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec86ab04-25be-4a06-a657-43b9ce8d1cc0]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:39 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b Sep 16 16:29:39 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:39 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b" returned: 0 in 0.488s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:39 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bda87e87-6567-4e96-ab39-9e8005ce59ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:29:39 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[601f3257-101d-4560-af1c-43aeb01717bf]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:39 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff Sep 16 16:29:39 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:40 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff" returned: 0 in 0.640s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:40 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b Sep 16 16:29:40 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:40 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b" returned: 0 in 0.422s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:40 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b Sep 16 16:29:40 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:40 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff.6fde6afd-08ec-4cd8-af42-10b8e4b7075b" returned: 0 in 0.321s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-6fde6afd-08ec-4cd8-af42-10b8e4b7075b" released by "_delete_snapshot" :: held 2.072s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-bda87e87-6567-4e96-ab39-9e8005ce59ff" released by "delete_snapshot" :: held 2.110s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:41 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Created reservations ['b6f68eed-8d99-4b47-8571-f56125478aec', '3b3af2df-12b9-4be3-8184-ef0f5aa84730', '2f9403c3-832d-4fd1-8f0c-bc1f11371522', '3ac29b83-88ff-48fc-88a1-ab746dbbbb98'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:41 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Delete snapshot completed successfully. Sep 16 16:29:41 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-3cb241ea-33d7-457b-b880-625e80e444fb tempest-ProjectMemberTests-954186186 None] Lock "cinder-6fde6afd-08ec-4cd8-af42-10b8e4b7075b-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:29:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:41 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:41 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:42 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.329s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 29 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-bda87e87-6567-4e96-ab39-9e8005ce59ff-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Lock "cinder-bda87e87-6567-4e96-ab39-9e8005ce59ff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-bda87e87-6567-4e96-ab39-9e8005ce59ff" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-bda87e87-6567-4e96-ab39-9e8005ce59ff" acquired by "delete_volume" :: waited 0.039s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf9f69b-295a-4dfd-9390-e7c3084f62db]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:42 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff Sep 16 16:29:42 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:42 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:42 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff Sep 16 16:29:42 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:43 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-bda87e87-6567-4e96-ab39-9e8005ce59ff" returned: 0 in 0.371s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-bda87e87-6567-4e96-ab39-9e8005ce59ff" released by "delete_volume" :: held 0.936s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Created reservations ['80389970-d010-43f3-8b9c-4b99954a9d32', 'bafadf93-922f-42c9-b4cc-26375925cd59', '3a422b59-5fae-465c-b83a-0f3fd710c305', '6d8a2e05-2837-4aad-988a-a21f3ef1927e'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:43 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:43 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:43 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.292s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:43 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Deleted volume successfully. Sep 16 16:29:43 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-071601a3-d399-417e-864e-239ed20bc4f3 tempest-ProjectMemberTests-954186186 None] Lock "cinder-bda87e87-6567-4e96-ab39-9e8005ce59ff-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (bb6ab549-af06-430d-87f4-94e349e2a49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90accc0c-de87-4240-850f-22cb5de5d2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90accc0c-de87-4240-850f-22cb5de5d2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-416996415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d336f8d8-ed6f-448b-89be-1b0557039fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:45Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50eb937-b70c-49ec-af4a-33986657a3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50eb937-b70c-49ec-af4a-33986657a3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976d5bbe-2ea5-4a6a-ba9f-97682c369360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976d5bbe-2ea5-4a6a-ba9f-97682c369360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd336f8d8-ed6f-448b-89be-1b0557039fc9', 'volume_name': 'volume-d336f8d8-ed6f-448b-89be-1b0557039fc9', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dc63ba-883d-46de-982e-265aaca12deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dc63ba-883d-46de-982e-265aaca12deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed25cbc-24ea-4b31-a68e-c7f27947b20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:45 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Volume d336f8d8-ed6f-448b-89be-1b0557039fc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d336f8d8-ed6f-448b-89be-1b0557039fc9', 'volume_size': 1} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-416996415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d336f8d8-ed6f-448b-89be-1b0557039fc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:45Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Creating volume d336f8d8-ed6f-448b-89be-1b0557039fc9 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:29:45 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:45 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 1073741824 Sep 16 16:29:45 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:45 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 1073741824" returned: 0 in 0.619s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:45 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 Sep 16 16:29:45 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:46 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9" returned: 0 in 0.326s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:29:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed25cbc-24ea-4b31-a68e-c7f27947b20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d336f8d8-ed6f-448b-89be-1b0557039fc9', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56d94dd-ac7e-4919-a942-7e70eb23377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:46 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Volume volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 (d336f8d8-ed6f-448b-89be-1b0557039fc9): created successfully Sep 16 16:29:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56d94dd-ac7e-4919-a942-7e70eb23377b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:46 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (bb6ab549-af06-430d-87f4-94e349e2a49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:46 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-7c7cdf38-03f9-4cc3-af42-1b2b45c6f69f tempest-ProjectMemberTests-954186186 None] Created volume successfully. Sep 16 16:29:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Creating offline snapshot eec74e92-71f4-405c-90d8-69b91596b457 of volume d336f8d8-ed6f-448b-89be-1b0557039fc9 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:29:47 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a6686e-fd03-4101-b470-6e0bed789d0a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:47 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 Sep 16 16:29:47 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:48 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9" returned: 0 in 0.485s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:48 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 1G Sep 16 16:29:48 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:48 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 1G" returned: 0 in 0.548s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:48 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 Sep 16 16:29:48 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:48 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457" returned: 0 in 0.404s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:48 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 is being set with open permissions: ugo+rw Sep 16 16:29:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:49 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 Sep 16 16:29:49 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:49 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457" returned: 0 in 0.310s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:49 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.info Sep 16 16:29:49 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:49 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.info" returned: 0 in 0.314s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:49 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.info is being set with open permissions: ugo+rw Sep 16 16:29:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:49 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.info Sep 16 16:29:49 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:49 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.info" returned: 0 in 0.323s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.530s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:50 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a7d0ff9c-11ca-4fad-92f7-b8209e41fd6b tempest-ProjectMemberTests-954186186 None] Create snapshot completed successfully Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-eec74e92-71f4-405c-90d8-69b91596b457-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Lock "cinder-eec74e92-71f4-405c-90d8-69b91596b457-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-d336f8d8-ed6f-448b-89be-1b0557039fc9" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-d336f8d8-ed6f-448b-89be-1b0557039fc9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-eec74e92-71f4-405c-90d8-69b91596b457" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-eec74e92-71f4-405c-90d8-69b91596b457" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Deleting offline snapshot eec74e92-71f4-405c-90d8-69b91596b457 of volume d336f8d8-ed6f-448b-89be-1b0557039fc9 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] snapshot_file for this snap is: volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7083503b-4a88-4789-b51f-cb2ab42ffe94]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:50 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 Sep 16 16:29:50 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:51 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457" returned: 0 in 0.477s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:51 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d336f8d8-ed6f-448b-89be-1b0557039fc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:29:51 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d10d6cf-89f8-45e1-baf7-2de5ddf2b6c9]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:51 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 Sep 16 16:29:51 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:51 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9" returned: 0 in 0.467s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:51 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 Sep 16 16:29:51 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:52 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457" returned: 0 in 0.525s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:52 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457 Sep 16 16:29:52 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:52 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9.eec74e92-71f4-405c-90d8-69b91596b457" returned: 0 in 0.308s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-eec74e92-71f4-405c-90d8-69b91596b457" released by "_delete_snapshot" :: held 1.930s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-d336f8d8-ed6f-448b-89be-1b0557039fc9" released by "delete_snapshot" :: held 1.962s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:52 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Created reservations ['924fd840-856c-4c21-9330-4f3d6f175b51', 'e1bc9f7e-8ba5-41ce-9375-84f7a69eb12a', 'af21b73a-a9e6-4cd4-837d-db95b03dfd2e', '36494f41-d608-4a18-b618-c4f2bb967599'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Delete snapshot completed successfully. Sep 16 16:29:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-d98ad776-33df-48ef-bf46-8f92e8b7d092 tempest-ProjectMemberTests-954186186 None] Lock "cinder-eec74e92-71f4-405c-90d8-69b91596b457-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-d336f8d8-ed6f-448b-89be-1b0557039fc9-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Lock "cinder-d336f8d8-ed6f-448b-89be-1b0557039fc9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-d336f8d8-ed6f-448b-89be-1b0557039fc9" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:29:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-d336f8d8-ed6f-448b-89be-1b0557039fc9" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:29:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[829200ab-516d-48dd-b85b-b93f1ab9634b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:54 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 Sep 16 16:29:54 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:54 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9" returned: 0 in 0.518s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:54 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9 Sep 16 16:29:54 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:55 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d336f8d8-ed6f-448b-89be-1b0557039fc9" returned: 0 in 0.316s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-d336f8d8-ed6f-448b-89be-1b0557039fc9" released by "delete_volume" :: held 0.956s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Created reservations ['0de99666-5039-4973-8b9e-ef1350c1d325', '7d48106d-7a19-4fac-9f1f-522b44c47bff', '1a0c644e-b58c-4869-84db-72947c853b1c', 'e9b8ab82-41bc-4d3a-96e9-4f421915e001'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:55 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:29:55 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:55 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.339s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:29:55 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Deleted volume successfully. Sep 16 16:29:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2f6720ce-26dd-4077-b6d2-d235df8d32be tempest-ProjectMemberTests-954186186 None] Lock "cinder-d336f8d8-ed6f-448b-89be-1b0557039fc9-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (49fe34e2-024b-4e4f-89cc-7675d784a9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf20f61-8c24-482f-8be7-88532fa19e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf20f61-8c24-482f-8be7-88532fa19e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600943974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf1ce20-f811-4914-8807-741cc3faf945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:57Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2133d634-323d-4d8b-b966-6160bf8d4f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2133d634-323d-4d8b-b966-6160bf8d4f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b93b664-8287-404c-9578-5d0f20143f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b93b664-8287-404c-9578-5d0f20143f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cf1ce20-f811-4914-8807-741cc3faf945', 'volume_name': 'volume-5cf1ce20-f811-4914-8807-741cc3faf945', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd90392-1319-4fec-924f-713398a7efff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd90392-1319-4fec-924f-713398a7efff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e45a3ea-4ce5-420e-ab1c-28a699cd4f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:57 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Volume 5cf1ce20-f811-4914-8807-741cc3faf945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cf1ce20-f811-4914-8807-741cc3faf945', 'volume_size': 1} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-600943974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cf1ce20-f811-4914-8807-741cc3faf945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:29:57Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Creating volume 5cf1ce20-f811-4914-8807-741cc3faf945 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:29:57 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:57 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 1073741824 Sep 16 16:29:57 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:57 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 1073741824" returned: 0 in 0.519s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:57 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 Sep 16 16:29:57 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:57 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945" returned: 0 in 0.300s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e45a3ea-4ce5-420e-ab1c-28a699cd4f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cf1ce20-f811-4914-8807-741cc3faf945', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354903cf-43b3-4edb-b89d-bca91fb9a93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:29:58 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Volume volume-5cf1ce20-f811-4914-8807-741cc3faf945 (5cf1ce20-f811-4914-8807-741cc3faf945): created successfully Sep 16 16:29:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354903cf-43b3-4edb-b89d-bca91fb9a93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:29:58 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (49fe34e2-024b-4e4f-89cc-7675d784a9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:29:58 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-04bc4946-a441-479a-9d05-eec04c66d428 tempest-ProjectMemberTests-954186186 None] Created volume successfully. Sep 16 16:29:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:29:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:29:59 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Creating offline snapshot bc7e7c95-bf16-465b-83e5-3cb0a5512339 of volume 5cf1ce20-f811-4914-8807-741cc3faf945 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:29:59 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81c3481-eb8f-4e52-982a-f1731056fa1b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:29:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:59 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 Sep 16 16:29:59 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:29:59 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 16 16:29:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945" returned: 0 in 0.407s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:29:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:29:59 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 1G Sep 16 16:29:59 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:00 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 1G" returned: 0 in 0.544s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cf1ce20-f811-4914-8807-741cc3faf945 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:00 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cf1ce20-f811-4914-8807-741cc3faf945 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 Sep 16 16:30:00 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:00 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cf1ce20-f811-4914-8807-741cc3faf945 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339" returned: 0 in 0.345s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:00 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 is being set with open permissions: ugo+rw Sep 16 16:30:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:00 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 Sep 16 16:30:00 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:00 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339" returned: 0 in 0.278s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:01 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.info Sep 16 16:30:01 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:01 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.info" returned: 0 in 0.312s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:01 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.info is being set with open permissions: ugo+rw Sep 16 16:30:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:01 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.info Sep 16 16:30:01 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:01 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.info" returned: 0 in 0.261s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:01 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5b05e567-0206-4bc4-bffd-cd8e96d5ab45 tempest-ProjectMemberTests-954186186 None] Create snapshot completed successfully Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-bc7e7c95-bf16-465b-83e5-3cb0a5512339-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Lock "cinder-bc7e7c95-bf16-465b-83e5-3cb0a5512339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-5cf1ce20-f811-4914-8807-741cc3faf945" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-5cf1ce20-f811-4914-8807-741cc3faf945" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-bc7e7c95-bf16-465b-83e5-3cb0a5512339" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-bc7e7c95-bf16-465b-83e5-3cb0a5512339" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Deleting offline snapshot bc7e7c95-bf16-465b-83e5-3cb0a5512339 of volume 5cf1ce20-f811-4914-8807-741cc3faf945 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] snapshot_file for this snap is: volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9428aa0c-fba1-4328-9d25-81df762d8940]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:02 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 Sep 16 16:30:02 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:03 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339" returned: 0 in 0.446s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:03 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cf1ce20-f811-4914-8807-741cc3faf945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:30:03 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c91a61c-cde8-4ed0-b4d3-d048c3e7c0ce]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:03 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 Sep 16 16:30:03 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:03 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945" returned: 0 in 0.440s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:03 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 Sep 16 16:30:03 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:04 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339" returned: 0 in 0.400s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:04 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339 Sep 16 16:30:04 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:04 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945.bc7e7c95-bf16-465b-83e5-3cb0a5512339" returned: 0 in 0.283s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-bc7e7c95-bf16-465b-83e5-3cb0a5512339" released by "_delete_snapshot" :: held 1.713s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-5cf1ce20-f811-4914-8807-741cc3faf945" released by "delete_snapshot" :: held 1.748s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Created reservations ['772aad6b-2aae-495f-9344-03333617e74f', '1a0f4bae-bd6b-46f6-a7f4-26ff3c3f7b97', '507498c2-894d-465a-96d7-26eea7d9e4c1', '0dea18bc-0dff-4037-a984-b7260c88107c'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:04 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Delete snapshot completed successfully. Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-decf5699-61f9-4cfe-9014-cea1769f620d tempest-ProjectMemberTests-954186186 None] Lock "cinder-bc7e7c95-bf16-465b-83e5-3cb0a5512339-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-5cf1ce20-f811-4914-8807-741cc3faf945-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Lock "cinder-5cf1ce20-f811-4914-8807-741cc3faf945-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-5cf1ce20-f811-4914-8807-741cc3faf945" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-5cf1ce20-f811-4914-8807-741cc3faf945" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdc5261-bb4d-4030-8a6f-19b86d5e988b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:05 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 Sep 16 16:30:05 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:05 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945" returned: 0 in 0.471s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:05 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945 Sep 16 16:30:05 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:05 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5cf1ce20-f811-4914-8807-741cc3faf945" returned: 0 in 0.311s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-5cf1ce20-f811-4914-8807-741cc3faf945" released by "delete_volume" :: held 0.867s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Created reservations ['63fe047a-7b51-4ff9-a625-fbd84e2e43b3', 'fe1e3d84-1a21-4844-b7c9-d4d5852a4733', '130978a5-a372-4f87-9276-6805f9df9d29', '52482e14-7f87-4b84-9e78-f7c8d06fd5ed'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:05 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:30:05 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:06 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.402s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:30:06 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Deleted volume successfully. Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-123ffe5f-5088-4e80-a9df-4cfcd65d891e tempest-ProjectMemberTests-954186186 None] Lock "cinder-5cf1ce20-f811-4914-8807-741cc3faf945-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (06e4759c-a8ff-40ec-b50e-57a360f7db6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f763c08c-8ccc-45c6-bc40-b3cd50b7a452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f763c08c-8ccc-45c6-bc40-b3cd50b7a452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220783213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6592d2f-8cb3-4452-8b3d-d73f3ef2806c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:07Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4474a093-db08-4014-aa1d-4aa3755e0ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4474a093-db08-4014-aa1d-4aa3755e0ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031a59a3-8636-4605-ac5a-b2d111de8fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031a59a3-8636-4605-ac5a-b2d111de8fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6592d2f-8cb3-4452-8b3d-d73f3ef2806c', 'volume_name': 'volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1696299-545e-4139-8eef-17da56ac3549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1696299-545e-4139-8eef-17da56ac3549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19dd6ee4-7257-47e6-9289-3bb3a3957332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:06 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Volume e6592d2f-8cb3-4452-8b3d-d73f3ef2806c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c', 'volume_size': 1} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220783213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6592d2f-8cb3-4452-8b3d-d73f3ef2806c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:07Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Creating volume e6592d2f-8cb3-4452-8b3d-d73f3ef2806c {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:30:06 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:30:06 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:06 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c 1073741824 Sep 16 16:30:06 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:07 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Flow 'volume_create_manager' (88858232-a1c8-4db5-a224-ab4102621baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4381f628-802b-4b75-8f34-040c91621d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c 1073741824" returned: 0 in 0.542s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4381f628-802b-4b75-8f34-040c91621d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-127841874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928e5711-b07e-4503-bff9-46cbeb7c9ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcbbf9e66e9483ca2ad0fd606ace792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:07Z,use_quota=True,user_id='dbb6b53329984049a4b8be482d2ee845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66f95c4-c944-43ee-aef1-25349d06c763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b66f95c4-c944-43ee-aef1-25349d06c763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92198493-df9d-435d-a7eb-d253573eb85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92198493-df9d-435d-a7eb-d253573eb85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928e5711-b07e-4503-bff9-46cbeb7c9ee8', 'volume_name': 'volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a513e67-242d-4555-bf0b-7091b54efc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a513e67-242d-4555-bf0b-7091b54efc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f1b7b4-c861-43b0-91d6-b99dbaffd52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:07 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Volume 928e5711-b07e-4503-bff9-46cbeb7c9ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8', 'volume_size': 1} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:07 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c Sep 16 16:30:07 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:07 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" returned: 0 in 0.270s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-127841874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928e5711-b07e-4503-bff9-46cbeb7c9ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcbbf9e66e9483ca2ad0fd606ace792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:07Z,use_quota=True,user_id='dbb6b53329984049a4b8be482d2ee845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Creating volume 928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:30:07 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19dd6ee4-7257-47e6-9289-3bb3a3957332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689c39c5-90d7-445b-a4d8-67aae2a27d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:07 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 1073741824 Sep 16 16:30:07 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:07 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Volume volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c (e6592d2f-8cb3-4452-8b3d-d73f3ef2806c): created successfully Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689c39c5-90d7-445b-a4d8-67aae2a27d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:07 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (06e4759c-a8ff-40ec-b50e-57a360f7db6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:07 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-cb07a671-bf1d-4e9e-9f37-39d7c0d2ef22 tempest-ProjectMemberTests-954186186 None] Created volume successfully. Sep 16 16:30:08 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 1073741824" returned: 0 in 0.454s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:08 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 Sep 16 16:30:08 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:08 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8" returned: 0 in 0.248s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:08 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:30:08 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f1b7b4-c861-43b0-91d6-b99dbaffd52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da9059f-c0e5-4c03-b4c7-f1e35aae7c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:08 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Volume volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 (928e5711-b07e-4503-bff9-46cbeb7c9ee8): created successfully Sep 16 16:30:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3da9059f-c0e5-4c03-b4c7-f1e35aae7c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:08 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Flow 'volume_create_manager' (88858232-a1c8-4db5-a224-ab4102621baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:08 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3febed31-4ece-4ce8-8bdd-70376864bc59 tempest-SnapshotDependencyTests-1869474139 None] Created volume successfully. Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Creating offline snapshot ef580518-28b1-49a9-9fe1-deccf1b95e78 of volume e6592d2f-8cb3-4452-8b3d-d73f3ef2806c {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[633927ee-e583-461a-92ea-24a12e3f3243]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:09 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c Sep 16 16:30:09 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:09 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" returned: 0 in 0.404s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:09 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 1G Sep 16 16:30:09 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:09 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 1G" returned: 0 in 0.463s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:10 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 Sep 16 16:30:10 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:10 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78" returned: 0 in 0.322s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:10 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 is being set with open permissions: ugo+rw Sep 16 16:30:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:10 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 Sep 16 16:30:10 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:10 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78" returned: 0 in 0.285s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:10 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.info Sep 16 16:30:10 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:10 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.info" returned: 0 in 0.278s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:10 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.info is being set with open permissions: ugo+rw Sep 16 16:30:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:10 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.info Sep 16 16:30:10 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:11 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.info" returned: 0 in 0.277s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.619s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:11 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Creating offline snapshot 24a503ba-39c1-4ada-9621-f687aab01e93 of volume 928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:30:11 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-014174a1-ea35-44bc-bc52-1ab14cfbb88d tempest-ProjectMemberTests-954186186 None] Create snapshot completed successfully Sep 16 16:30:11 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[11642aed-a6a7-4488-a476-31adb3098726]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:11 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 Sep 16 16:30:11 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:11 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8" returned: 0 in 0.447s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:11 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 1G Sep 16 16:30:11 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:12 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 1G" returned: 0 in 0.482s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:12 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 Sep 16 16:30:12 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-ef580518-28b1-49a9-9fe1-deccf1b95e78-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Lock "cinder-ef580518-28b1-49a9-9fe1-deccf1b95e78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-ef580518-28b1-49a9-9fe1-deccf1b95e78" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-ef580518-28b1-49a9-9fe1-deccf1b95e78" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Deleting offline snapshot ef580518-28b1-49a9-9fe1-deccf1b95e78 of volume e6592d2f-8cb3-4452-8b3d-d73f3ef2806c {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] snapshot_file for this snap is: volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce75fef-54e7-4964-84c7-88d89691d24e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:12 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 Sep 16 16:30:12 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:12 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93" returned: 0 in 0.414s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:12 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 is being set with open permissions: ugo+rw Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:12 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 Sep 16 16:30:12 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:12 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78" returned: 0 in 0.452s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe78f03-4899-4ab9-9fc1-5c7d78c61221]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:12 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93" returned: 0 in 0.320s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:12 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.info Sep 16 16:30:12 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:13 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c Sep 16 16:30:13 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:13 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.info" returned: 0 in 0.288s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:13 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.info is being set with open permissions: ugo+rw Sep 16 16:30:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:13 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.info Sep 16 16:30:13 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:13 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" returned: 0 in 0.441s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:13 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 Sep 16 16:30:13 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:13 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.info" returned: 0 in 0.344s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:13 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-52a7ce95-9151-4f34-96b9-e541b7d413ad tempest-SnapshotDependencyTests-1869474139 None] Create snapshot completed successfully Sep 16 16:30:13 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78" returned: 0 in 0.438s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:13 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78 Sep 16 16:30:13 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:14 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c.ef580518-28b1-49a9-9fe1-deccf1b95e78" returned: 0 in 0.307s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-ef580518-28b1-49a9-9fe1-deccf1b95e78" released by "_delete_snapshot" :: held 1.768s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" released by "delete_snapshot" :: held 1.798s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Created reservations ['36adfe6f-cbaa-4cbc-8a78-fa0085dc1eea', '1b9d7db7-601e-4dab-b879-25d9eeb721bc', 'a502c70a-eadd-4a36-981c-08f231d75aae', '34def3f6-9961-41f1-9fb1-d69f83427caf'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Delete snapshot completed successfully. Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f508e08f-f749-430f-9907-105e7d499a8b tempest-ProjectMemberTests-954186186 None] Lock "cinder-ef580518-28b1-49a9-9fe1-deccf1b95e78-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Lock "cinder-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1a60c4-810d-4173-a9e6-27a60c84523f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Flow 'volume_create_manager' (3f68b9e4-c63c-4cca-8610-82c4a7ba2b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3194b0-ea35-4677-bea9-ab1034013208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3194b0-ea35-4677-bea9-ab1034013208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb9c7f3-a7a2-4903-8844-5f4c8475a0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dcbbf9e66e9483ca2ad0fd606ace792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=24a503ba-39c1-4ada-9621-f687aab01e93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:15Z,use_quota=True,user_id='dbb6b53329984049a4b8be482d2ee845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35be8d97-ddaf-4018-9feb-7ee305989261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35be8d97-ddaf-4018-9feb-7ee305989261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899c0b1e-ba4d-464a-9f83-a84d4774e05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:14 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c Sep 16 16:30:14 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899c0b1e-ba4d-464a-9f83-a84d4774e05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'feb9c7f3-a7a2-4903-8844-5f4c8475a0db', 'volume_name': 'volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db', 'volume_size': 1, 'snapshot_id': '24a503ba-39c1-4ada-9621-f687aab01e93'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7e67d8-7b1a-4eec-a37b-b12e51122674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c7e67d8-7b1a-4eec-a37b-b12e51122674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ca62ef-7c67-4aad-b346-e840ca2494c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:14 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Volume feb9c7f3-a7a2-4903-8844-5f4c8475a0db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db', 'volume_size': 1, 'snapshot_id': '24a503ba-39c1-4ada-9621-f687aab01e93'} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "cinder-quobyte-24a503ba-39c1-4ada-9621-f687aab01e93-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" by "_create_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-24a503ba-39c1-4ada-9621-f687aab01e93-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Creating volume feb9c7f3-a7a2-4903-8844-5f4c8475a0db from snapshot 24a503ba-39c1-4ada-9621-f687aab01e93 {{(pid=86255) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "cinder-quobyte-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" by "_copy_volume_from_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] snapshot: 24a503ba-39c1-4ada-9621-f687aab01e93, volume: feb9c7f3-a7a2-4903-8844-5f4c8475a0db, {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77dab25-467d-48c2-bc06-944c25011d3b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:15 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 Sep 16 16:30:15 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:15 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" returned: 0 in 0.458s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:15 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c Sep 16 16:30:15 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:15 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93" returned: 0 in 0.451s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:30:15 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" returned: 0 in 0.295s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ecac13-0fec-422b-8c15-615b974ba899]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c" released by "delete_volume" :: held 0.850s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Created reservations ['9ebd956b-d22a-48a9-94ae-4de10cf4f0ca', '2e4ecf3c-f2f7-4ea6-87f6-5d7ee3ec81c1', '39b961ed-dab4-4579-8d08-ddee97a5f76f', 'ccd276e1-afb0-4670-b06e-f5dfa1b421a0'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:15 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 Sep 16 16:30:15 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:15 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:30:15 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:15 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8" returned: 0 in 0.444s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Creating direct copy from snapshot {{(pid=86255) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.utils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Path /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db not found in is_blk_device check {{(pid=86255) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:15 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db Sep 16 16:30:15 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:15 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.339s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:30:15 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Deleted volume successfully. Sep 16 16:30:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f9682c67-8690-40ab-8a64-968536f17512 tempest-ProjectMemberTests-954186186 None] Lock "cinder-e6592d2f-8cb3-4452-8b3d-d73f3ef2806c-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (ceef3782-c0ae-4d4b-a633-19c8eea48c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e5d8c0-3c41-4ed9-a9af-37220d9cbc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e5d8c0-3c41-4ed9-a9af-37220d9cbc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-636891472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9d3a98-9acd-4e9a-b408-77838ff9c2e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:16Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f963f0f7-a173-4c6f-93ac-d5d54cf258e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f963f0f7-a173-4c6f-93ac-d5d54cf258e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d323af21-d4e6-4b65-b02f-b9a21c884bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d323af21-d4e6-4b65-b02f-b9a21c884bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9d3a98-9acd-4e9a-b408-77838ff9c2e0', 'volume_name': 'volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d2a45b-b226-41d7-be6e-8817e37975d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d2a45b-b226-41d7-be6e-8817e37975d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d088ce-0f67-444a-b655-19e744f3e089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:16 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Volume 9e9d3a98-9acd-4e9a-b408-77838ff9c2e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0', 'volume_size': 1} Sep 16 16:30:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:21 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" returned: 0 in 5.904s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:21 devstack cinder-volume[86255]: DEBUG cinder.image.image_utils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Image conversion details: src /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db {{(pid=86255) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 16 16:30:21 devstack cinder-volume[86255]: INFO cinder.image.image_utils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Converted 1024.00 MB image at 173.42 MB/s Sep 16 16:30:21 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db is being set with open permissions: ugo+rw Sep 16 16:30:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:21 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db Sep 16 16:30:21 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:21 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" returned: 0 in 0.236s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" released by "_copy_volume_from_snapshot" :: held 7.157s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-24a503ba-39c1-4ada-9621-f687aab01e93-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" released by "_create_volume_from_snapshot" :: held 7.230s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.248s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.708s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-636891472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9d3a98-9acd-4e9a-b408-77838ff9c2e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:16Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Creating volume 9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:30:22 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:22 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 1073741824 Sep 16 16:30:22 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ca62ef-7c67-4aad-b346-e840ca2494c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db', 'volume_size': 1, 'snapshot_id': '24a503ba-39c1-4ada-9621-f687aab01e93'}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a398c496-131b-4c23-a4e1-22eab71af293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:22 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Volume volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db (feb9c7f3-a7a2-4903-8844-5f4c8475a0db): created successfully Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a398c496-131b-4c23-a4e1-22eab71af293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Flow 'volume_create_manager' (3f68b9e4-c63c-4cca-8610-82c4a7ba2b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-fe2ea0f8-d9d3-42bc-a20e-4acc4a48984e tempest-SnapshotDependencyTests-1869474139 None] Created volume successfully. Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "cinder-24a503ba-39c1-4ada-9621-f687aab01e93-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-24a503ba-39c1-4ada-9621-f687aab01e93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "cinder-quobyte-928e5711-b07e-4503-bff9-46cbeb7c9ee8" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-928e5711-b07e-4503-bff9-46cbeb7c9ee8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "cinder-quobyte-24a503ba-39c1-4ada-9621-f687aab01e93" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-24a503ba-39c1-4ada-9621-f687aab01e93" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Deleting offline snapshot 24a503ba-39c1-4ada-9621-f687aab01e93 of volume 928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] snapshot_file for this snap is: volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be55a72-f765-46d9-952f-9ca8afcface2]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:22 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 1073741824" returned: 0 in 0.466s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:22 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 Sep 16 16:30:22 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:22 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 Sep 16 16:30:22 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:22 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" returned: 0 in 0.254s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d088ce-0f67-444a-b655-19e744f3e089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70f5dec-fbb1-4879-9bce-b88b41edc59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:22 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93" returned: 0 in 0.391s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:30:22 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Volume volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 (9e9d3a98-9acd-4e9a-b408-77838ff9c2e0): created successfully Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70f5dec-fbb1-4879-9bce-b88b41edc59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (ceef3782-c0ae-4d4b-a633-19c8eea48c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6021c99-4c8e-495c-af27-eb6309bca7df]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:22 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9d9edd46-bf27-4412-bee5-2735dd082286 tempest-ProjectMemberTests-954186186 None] Created volume successfully. Sep 16 16:30:22 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 Sep 16 16:30:22 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:23 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8" returned: 0 in 0.517s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:23 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 Sep 16 16:30:23 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:23 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93" returned: 0 in 0.317s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:23 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93 Sep 16 16:30:23 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:23 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8.24a503ba-39c1-4ada-9621-f687aab01e93" returned: 0 in 0.266s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-24a503ba-39c1-4ada-9621-f687aab01e93" released by "_delete_snapshot" :: held 1.625s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-928e5711-b07e-4503-bff9-46cbeb7c9ee8" released by "delete_snapshot" :: held 1.649s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Creating offline snapshot f51671d6-b56a-45c9-991a-37d5ffa2e9ef of volume 9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[615ec27e-7cde-472a-82dc-d9d6fddfc234]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Created reservations ['a959d282-6094-40cc-a7ed-04229bc45e43', '4c832061-5d62-49be-82f2-69b66247f8be', '6514e1a4-f4ad-4026-9ebb-e4ee39a67c07', '48935737-a76e-408c-bd77-a1b9e325e072'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:24 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Delete snapshot completed successfully. Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-748cc856-5dbb-4048-adc5-a02e355ba334 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-24a503ba-39c1-4ada-9621-f687aab01e93-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:24 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 Sep 16 16:30:24 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:24 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" returned: 0 in 0.373s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "cinder-928e5711-b07e-4503-bff9-46cbeb7c9ee8-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:24 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef 1G Sep 16 16:30:24 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-928e5711-b07e-4503-bff9-46cbeb7c9ee8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "cinder-quobyte-928e5711-b07e-4503-bff9-46cbeb7c9ee8" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-928e5711-b07e-4503-bff9-46cbeb7c9ee8" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f202cc-3839-435c-ae21-d31f69536458]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:24 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 Sep 16 16:30:24 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:24 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef 1G" returned: 0 in 0.462s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:24 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef Sep 16 16:30:24 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:25 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8" returned: 0 in 0.413s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:25 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8 Sep 16 16:30:25 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:25 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef" returned: 0 in 0.333s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:25 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef is being set with open permissions: ugo+rw Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:25 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-928e5711-b07e-4503-bff9-46cbeb7c9ee8" returned: 0 in 0.278s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:25 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef Sep 16 16:30:25 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-928e5711-b07e-4503-bff9-46cbeb7c9ee8" released by "delete_volume" :: held 0.757s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Created reservations ['946e0603-8236-40c4-bb3e-bb9d4286e25f', '8bb85cda-1185-4c19-8d25-a8d4660bfe30', '5eddfd48-2b97-444a-bb6b-363195cbd2b1', 'ecbdc6f9-c1c4-4c09-99c5-7429e3bf77cb'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:25 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:30:25 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:25 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:25 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.info Sep 16 16:30:25 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "cinder-feb9c7f3-a7a2-4903-8844-5f4c8475a0db-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-feb9c7f3-a7a2-4903-8844-5f4c8475a0db-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "cinder-quobyte-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:25 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.336s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:30:25 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Deleted volume successfully. Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb01dde-4e0c-432f-8541-52264f1181ac]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-92dd8033-bdd7-421f-83f2-0597615cb736 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-928e5711-b07e-4503-bff9-46cbeb7c9ee8-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:25 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.info" returned: 0 in 0.308s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:25 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.info is being set with open permissions: ugo+rw Sep 16 16:30:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:25 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.info Sep 16 16:30:25 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:25 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db Sep 16 16:30:25 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:26 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.info" returned: 0 in 0.260s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:26 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-80152722-6440-42fd-9acd-aaa7f9fbeb25 tempest-ProjectMemberTests-954186186 None] Create snapshot completed successfully Sep 16 16:30:26 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" returned: 0 in 0.414s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:26 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db Sep 16 16:30:26 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:26 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" returned: 0 in 0.249s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-quobyte-feb9c7f3-a7a2-4903-8844-5f4c8475a0db" released by "delete_volume" :: held 0.724s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Created reservations ['cff9c78b-cf8d-4fc7-a3fe-9c068aba32c5', '22ddea03-77cb-4e6b-ba66-6e031c05a2d3', '4a6e84a2-b578-4337-9491-3df5fd7d179d', '7650bdd5-c3be-4e3d-84bc-786073dc01f8'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:26 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:30:26 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:26 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.260s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:30:26 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Deleted volume successfully. Sep 16 16:30:26 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e3bccc42-fd52-412d-8779-2af1a2269210 tempest-SnapshotDependencyTests-1869474139 None] Lock "cinder-feb9c7f3-a7a2-4903-8844-5f4c8475a0db-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-f51671d6-b56a-45c9-991a-37d5ffa2e9ef-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Lock "cinder-f51671d6-b56a-45c9-991a-37d5ffa2e9ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-f51671d6-b56a-45c9-991a-37d5ffa2e9ef" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-f51671d6-b56a-45c9-991a-37d5ffa2e9ef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Deleting offline snapshot f51671d6-b56a-45c9-991a-37d5ffa2e9ef of volume 9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] snapshot_file for this snap is: volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eefab85-03cd-4a76-af4d-a5af96cd041d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:27 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef Sep 16 16:30:27 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:27 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef" returned: 0 in 0.474s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e23be52-a5b0-49be-88af-033bb0ebac77]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:28 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 Sep 16 16:30:28 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:28 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" returned: 0 in 0.403s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:28 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef Sep 16 16:30:28 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:28 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef" returned: 0 in 0.422s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:28 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef Sep 16 16:30:28 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:29 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0.f51671d6-b56a-45c9-991a-37d5ffa2e9ef" returned: 0 in 0.284s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-f51671d6-b56a-45c9-991a-37d5ffa2e9ef" released by "_delete_snapshot" :: held 1.707s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" released by "delete_snapshot" :: held 1.732s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=98,cinder:INSERT=40,cinder:UPDATE=122,cinder:DELETE=16 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=132,cinder:SELECT=108,cinder:INSERT=27,cinder:DELETE=7 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Created reservations ['87aa9029-0ed9-4ef7-9a93-8264eb80bd04', 'bdda8f3c-3a74-4afb-8615-b33f2016fe2b', '41a8fc57-b1b1-4f5c-a11b-30d8ed8738d5', '265db559-8fcc-4b17-8db5-ffe2d957ec3d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:29 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Delete snapshot completed successfully. Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1239ca1e-7a26-46dd-9ee9-9b181535742e tempest-ProjectMemberTests-954186186 None] Lock "cinder-f51671d6-b56a-45c9-991a-37d5ffa2e9ef-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Lock "cinder-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" acquired by "delete_volume" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aa1c25-b773-4ec7-84b0-a43112c674de]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:29 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 Sep 16 16:30:29 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:30 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" returned: 0 in 0.420s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:30 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0 Sep 16 16:30:30 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:30 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" returned: 0 in 0.252s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0" released by "delete_volume" :: held 0.743s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Created reservations ['9fa41c35-4f2e-4d28-aa56-c9e259dfcd03', '2e3a5fcc-ed33-433f-9810-07895d629e8b', '3f98db6d-a79a-40d9-96fd-233c86e68108', 'cfcc24eb-eb03-4d49-8952-7fc1eb778d1e'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:30 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:30:30 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:30 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.302s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:30:30 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Deleted volume successfully. Sep 16 16:30:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8e318289-e716-47cd-af30-194b1c7bbb32 tempest-ProjectMemberTests-954186186 None] Lock "cinder-9e9d3a98-9acd-4e9a-b408-77838ff9c2e0-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (c332ca66-7d51-49c6-8a31-23bc9bb6b0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4b432d-97aa-4570-90a4-23fb8b9622da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4b432d-97aa-4570-90a4-23fb8b9622da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421779570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61d3b1a-7999-4831-a0d2-b3697250587f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:31Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d68f58-5538-4acf-b46f-df09db8afc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d68f58-5538-4acf-b46f-df09db8afc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fe8b15-688e-4878-8c38-f10ef8cfba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fe8b15-688e-4878-8c38-f10ef8cfba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a61d3b1a-7999-4831-a0d2-b3697250587f', 'volume_name': 'volume-a61d3b1a-7999-4831-a0d2-b3697250587f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c510c18-e1c1-40d4-83d4-257858fed6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c510c18-e1c1-40d4-83d4-257858fed6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1133d3d5-7017-4203-a1e0-60541d4dec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:31 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Volume a61d3b1a-7999-4831-a0d2-b3697250587f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a61d3b1a-7999-4831-a0d2-b3697250587f', 'volume_size': 1} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421779570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a61d3b1a-7999-4831-a0d2-b3697250587f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:31Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Creating volume a61d3b1a-7999-4831-a0d2-b3697250587f {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:30:31 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:30:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:31 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f 1073741824 Sep 16 16:30:31 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:32 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f 1073741824" returned: 0 in 0.702s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:32 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f Sep 16 16:30:32 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:32 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f" returned: 0 in 0.260s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:30:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1133d3d5-7017-4203-a1e0-60541d4dec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a61d3b1a-7999-4831-a0d2-b3697250587f', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbb27d3-77e6-41b3-9460-5a545b26bf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:32 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Volume volume-a61d3b1a-7999-4831-a0d2-b3697250587f (a61d3b1a-7999-4831-a0d2-b3697250587f): created successfully Sep 16 16:30:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbb27d3-77e6-41b3-9460-5a545b26bf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (c332ca66-7d51-49c6-8a31-23bc9bb6b0aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-47c11d63-7b62-4cb7-9bd8-3a82076275d5 tempest-ProjectMemberTests-954186186 None] Created volume successfully. Sep 16 16:30:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Creating offline snapshot 080cd861-924b-4d64-9948-bf0c44d767d5 of volume a61d3b1a-7999-4831-a0d2-b3697250587f {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:30:33 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cab767-fc2e-4d3d-918d-a20893f5e8b9]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:33 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f Sep 16 16:30:33 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:34 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f" returned: 0 in 0.430s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:34 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 1G Sep 16 16:30:34 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:34 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 1G" returned: 0 in 0.475s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a61d3b1a-7999-4831-a0d2-b3697250587f -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:34 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a61d3b1a-7999-4831-a0d2-b3697250587f -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 Sep 16 16:30:34 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:35 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a61d3b1a-7999-4831-a0d2-b3697250587f -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5" returned: 0 in 0.320s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:35 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 is being set with open permissions: ugo+rw Sep 16 16:30:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:35 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 Sep 16 16:30:35 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:35 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5" returned: 0 in 0.299s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:35 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.info Sep 16 16:30:35 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:35 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.info" returned: 0 in 0.268s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:35 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.info is being set with open permissions: ugo+rw Sep 16 16:30:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:35 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.info Sep 16 16:30:35 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:35 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.info" returned: 0 in 0.247s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.133s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:35 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-3f0f7a16-ca6d-42c3-a3c5-c9de913d0962 tempest-ProjectMemberTests-954186186 None] Create snapshot completed successfully Sep 16 16:30:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-080cd861-924b-4d64-9948-bf0c44d767d5-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Lock "cinder-080cd861-924b-4d64-9948-bf0c44d767d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:36 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-a61d3b1a-7999-4831-a0d2-b3697250587f" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-a61d3b1a-7999-4831-a0d2-b3697250587f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-080cd861-924b-4d64-9948-bf0c44d767d5" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-080cd861-924b-4d64-9948-bf0c44d767d5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Deleting offline snapshot 080cd861-924b-4d64-9948-bf0c44d767d5 of volume a61d3b1a-7999-4831-a0d2-b3697250587f {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] snapshot_file for this snap is: volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b06ffac-b69a-47ed-ad2d-6b7a7e0ce738]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:37 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 Sep 16 16:30:37 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:37 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5" returned: 0 in 0.419s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a61d3b1a-7999-4831-a0d2-b3697250587f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e6345c-c35f-4b7a-8b7f-11cd53a2616a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:37 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f Sep 16 16:30:37 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:37 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f" returned: 0 in 0.431s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:38 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 Sep 16 16:30:38 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:38 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5" returned: 0 in 0.431s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:38 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5 Sep 16 16:30:38 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:38 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f.080cd861-924b-4d64-9948-bf0c44d767d5" returned: 0 in 0.257s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-080cd861-924b-4d64-9948-bf0c44d767d5" released by "_delete_snapshot" :: held 1.681s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-a61d3b1a-7999-4831-a0d2-b3697250587f" released by "delete_snapshot" :: held 1.706s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:38 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Created reservations ['4b805d75-eb34-4aaf-ac20-403bd614d485', '4a286f4c-19b0-4146-a85d-0921779cecd0', '5dc1d06d-c793-4c96-aa3c-45d57b7cb394', '84a1e0a7-94c6-4a72-beef-fb5908f522af'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:38 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Delete snapshot completed successfully. Sep 16 16:30:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-8057d603-f3c4-492f-b1b0-8129f5cdf812 tempest-ProjectMemberTests-954186186 None] Lock "cinder-080cd861-924b-4d64-9948-bf0c44d767d5-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-a61d3b1a-7999-4831-a0d2-b3697250587f-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Lock "cinder-a61d3b1a-7999-4831-a0d2-b3697250587f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-a61d3b1a-7999-4831-a0d2-b3697250587f" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-a61d3b1a-7999-4831-a0d2-b3697250587f" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7600d882-ce0c-4e3c-b70c-489e5899dda6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:39 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f Sep 16 16:30:39 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:39 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f" returned: 0 in 0.362s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:39 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f Sep 16 16:30:39 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:39 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-a61d3b1a-7999-4831-a0d2-b3697250587f" returned: 0 in 0.247s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-a61d3b1a-7999-4831-a0d2-b3697250587f" released by "delete_volume" :: held 0.680s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:39 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Created reservations ['bf5c2682-e3b1-4ebd-9ef2-d00c0a143158', 'bee3de9a-46a5-47d2-bbba-04ff4a31338e', '846a2086-a0e6-4210-aaba-bb7dd5c75613', '0c1d0b4e-86c5-4695-81dd-06da2a4c3f8d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:40 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:30:40 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:40 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.269s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:30:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Deleted volume successfully. Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a1367578-d9aa-4fb7-af9d-b4e1323c775f tempest-ProjectMemberTests-954186186 None] Lock "cinder-a61d3b1a-7999-4831-a0d2-b3697250587f-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (486b255b-cb2f-46d9-926d-33bb30ae9f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6d41a8-7501-48a9-87fd-0d8bb9806aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea6d41a8-7501-48a9-87fd-0d8bb9806aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-602151878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c19734-f8a5-4a8d-8791-a25b6a0329db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:41Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea427b40-bb80-4a46-b25d-2265a622aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea427b40-bb80-4a46-b25d-2265a622aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fa2838-c014-4780-b19e-07b8c95abc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fa2838-c014-4780-b19e-07b8c95abc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51c19734-f8a5-4a8d-8791-a25b6a0329db', 'volume_name': 'volume-51c19734-f8a5-4a8d-8791-a25b6a0329db', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e41368-a702-402e-bbc5-046073dfd8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e41368-a702-402e-bbc5-046073dfd8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc35775a-f059-4e19-a698-416219e537ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:40 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Volume 51c19734-f8a5-4a8d-8791-a25b6a0329db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51c19734-f8a5-4a8d-8791-a25b6a0329db', 'volume_size': 1} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-602151878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51c19734-f8a5-4a8d-8791-a25b6a0329db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:41Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Creating volume 51c19734-f8a5-4a8d-8791-a25b6a0329db {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:30:40 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:30:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:40 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db 1073741824 Sep 16 16:30:40 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:41 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db 1073741824" returned: 0 in 0.456s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:41 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db Sep 16 16:30:41 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:41 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db" returned: 0 in 0.258s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc35775a-f059-4e19-a698-416219e537ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51c19734-f8a5-4a8d-8791-a25b6a0329db', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2003ed6f-336c-4f87-a3c4-5e2067a6fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:41 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Volume volume-51c19734-f8a5-4a8d-8791-a25b6a0329db (51c19734-f8a5-4a8d-8791-a25b6a0329db): created successfully Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2003ed6f-336c-4f87-a3c4-5e2067a6fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (486b255b-cb2f-46d9-926d-33bb30ae9f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:41 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e8bb6a83-14ac-4194-8c25-008b35f37b44 tempest-ProjectMemberTests-954186186 None] Created volume successfully. Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:41 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:30:41 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Creating offline snapshot f752f1ac-8838-496e-a4de-a567ea1b2afc of volume 51c19734-f8a5-4a8d-8791-a25b6a0329db {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:30:42 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.283s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 29 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b07d41-6ed3-4429-b2e1-29de33969ada]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:42 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db Sep 16 16:30:42 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:42 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db" returned: 0 in 0.364s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:42 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc 1G Sep 16 16:30:42 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:42 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc 1G" returned: 0 in 0.431s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51c19734-f8a5-4a8d-8791-a25b6a0329db -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:42 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51c19734-f8a5-4a8d-8791-a25b6a0329db -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc Sep 16 16:30:42 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:43 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51c19734-f8a5-4a8d-8791-a25b6a0329db -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc" returned: 0 in 0.306s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:43 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc is being set with open permissions: ugo+rw Sep 16 16:30:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:43 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc Sep 16 16:30:43 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:43 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc" returned: 0 in 0.263s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:43 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.info Sep 16 16:30:43 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:43 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.info" returned: 0 in 0.268s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:43 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.info is being set with open permissions: ugo+rw Sep 16 16:30:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:43 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.info Sep 16 16:30:43 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:43 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.info" returned: 0 in 0.247s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:44 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-68e63d87-55a1-4b9c-9571-b393dbab8620 tempest-ProjectMemberTests-954186186 None] Create snapshot completed successfully Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-f752f1ac-8838-496e-a4de-a567ea1b2afc-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Lock "cinder-f752f1ac-8838-496e-a4de-a567ea1b2afc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-51c19734-f8a5-4a8d-8791-a25b6a0329db" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-51c19734-f8a5-4a8d-8791-a25b6a0329db" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-f752f1ac-8838-496e-a4de-a567ea1b2afc" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-f752f1ac-8838-496e-a4de-a567ea1b2afc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Deleting offline snapshot f752f1ac-8838-496e-a4de-a567ea1b2afc of volume 51c19734-f8a5-4a8d-8791-a25b6a0329db {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] snapshot_file for this snap is: volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5d2357-79b7-4c2c-9a20-d72eb629e94a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:44 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc Sep 16 16:30:44 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:44 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc" returned: 0 in 0.374s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51c19734-f8a5-4a8d-8791-a25b6a0329db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[70728a25-3288-4108-8b8f-4fb4cae9b364]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:44 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db Sep 16 16:30:44 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:45 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db" returned: 0 in 0.385s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:45 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc Sep 16 16:30:45 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:45 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc" returned: 0 in 0.365s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:45 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc Sep 16 16:30:45 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:45 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db.f752f1ac-8838-496e-a4de-a567ea1b2afc" returned: 0 in 0.258s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-f752f1ac-8838-496e-a4de-a567ea1b2afc" released by "_delete_snapshot" :: held 1.492s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-51c19734-f8a5-4a8d-8791-a25b6a0329db" released by "delete_snapshot" :: held 1.517s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:45 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Created reservations ['67bc174c-0ce7-4b24-8f68-d206085a72cc', '67f3fd75-1307-4c0b-aee6-e10ffbb2ec70', '88555d65-2a26-4c69-a9de-0fb55abedbf8', 'd87c2b99-adc7-4ecb-b9ea-20a354a67008'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Delete snapshot completed successfully. Sep 16 16:30:45 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-6f0ea324-1153-4374-9e96-7498a2e3e299 tempest-ProjectMemberTests-954186186 None] Lock "cinder-f752f1ac-8838-496e-a4de-a567ea1b2afc-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-51c19734-f8a5-4a8d-8791-a25b6a0329db-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Lock "cinder-51c19734-f8a5-4a8d-8791-a25b6a0329db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-51c19734-f8a5-4a8d-8791-a25b6a0329db" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-51c19734-f8a5-4a8d-8791-a25b6a0329db" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:46 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee2be37-2e44-4080-987a-a6fbf018137d]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:46 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db Sep 16 16:30:46 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:46 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db" returned: 0 in 0.397s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:46 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db Sep 16 16:30:46 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:47 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-51c19734-f8a5-4a8d-8791-a25b6a0329db" returned: 0 in 0.268s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-51c19734-f8a5-4a8d-8791-a25b6a0329db" released by "delete_volume" :: held 0.735s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Created reservations ['72e20da8-8f42-4d1c-a7b8-74522f9925f3', '259684e5-12c4-4ba5-b755-6eed4cccf823', '20598122-55c5-4c71-a5f8-e2e424f19b35', 'b3279b4a-78d5-48c7-91a4-dcfa37177237'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:47 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:30:47 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:47 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.274s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:30:47 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Deleted volume successfully. Sep 16 16:30:47 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-dc24cf36-41e3-4d58-8205-86fc6c7437d8 tempest-ProjectMemberTests-954186186 None] Lock "cinder-51c19734-f8a5-4a8d-8791-a25b6a0329db-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (54cb4fc7-6b73-4619-8915-d0185e5b596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93ced44-34f6-4a22-bd2a-dd8494f1cb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e93ced44-34f6-4a22-bd2a-dd8494f1cb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231396993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:48Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cdd9d5-e6ff-492f-8fbf-310ed6713fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cdd9d5-e6ff-492f-8fbf-310ed6713fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d95fb5-7230-4cba-ac5c-0117f3ff3ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d95fb5-7230-4cba-ac5c-0117f3ff3ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2', 'volume_name': 'volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215fb148-e363-4ef6-80c3-c6d9489c16ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215fb148-e363-4ef6-80c3-c6d9489c16ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50744c03-3033-416b-94fb-93f6638e8694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:48 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Volume ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2', 'volume_size': 1} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-231396993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:48Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Creating volume ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:30:48 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:48 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 1073741824 Sep 16 16:30:48 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:48 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 1073741824" returned: 0 in 0.469s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:48 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 Sep 16 16:30:48 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:48 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" returned: 0 in 0.251s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50744c03-3033-416b-94fb-93f6638e8694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d6d8fb-1dbc-4458-a442-c6de59491ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:48 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Volume volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 (ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2): created successfully Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d6d8fb-1dbc-4458-a442-c6de59491ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:48 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (54cb4fc7-6b73-4619-8915-d0185e5b596e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:48 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-055fce24-9650-491b-830c-9ec59b20c81d tempest-ProjectMemberTests-954186186 None] Created volume successfully. Sep 16 16:30:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:50 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Creating offline snapshot 7077c374-9895-4d1c-9547-1c025b79512a of volume ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:30:50 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[38563385-272c-467d-9c71-b3c0cf533418]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:50 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 Sep 16 16:30:50 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:50 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" returned: 0 in 0.362s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:50 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a 1G Sep 16 16:30:50 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:51 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a 1G" returned: 0 in 0.384s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:51 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a Sep 16 16:30:51 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:51 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a" returned: 0 in 0.295s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:51 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a is being set with open permissions: ugo+rw Sep 16 16:30:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:51 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a Sep 16 16:30:51 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:51 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a" returned: 0 in 0.238s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:51 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.info Sep 16 16:30:51 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:51 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.info" returned: 0 in 0.260s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:51 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.info is being set with open permissions: ugo+rw Sep 16 16:30:51 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:51 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.info Sep 16 16:30:51 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:52 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.info" returned: 0 in 0.239s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:52 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-68388529-0d96-4c70-8b29-89bb2c36563d tempest-ProjectMemberTests-954186186 None] Create snapshot completed successfully Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-7077c374-9895-4d1c-9547-1c025b79512a-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Lock "cinder-7077c374-9895-4d1c-9547-1c025b79512a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-7077c374-9895-4d1c-9547-1c025b79512a" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-7077c374-9895-4d1c-9547-1c025b79512a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Deleting offline snapshot 7077c374-9895-4d1c-9547-1c025b79512a of volume ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] snapshot_file for this snap is: volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b1193c-1ffc-4983-b4c6-727c007a4bde]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:52 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a Sep 16 16:30:52 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:52 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a" returned: 0 in 0.361s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea6e7ff-fb50-4cf3-af83-480db1f4663e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:52 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:53 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 Sep 16 16:30:53 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:53 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" returned: 0 in 0.401s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:53 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a Sep 16 16:30:53 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:53 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a" returned: 0 in 0.337s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:53 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a Sep 16 16:30:53 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:53 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:53 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2.7077c374-9895-4d1c-9547-1c025b79512a" returned: 0 in 0.265s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-7077c374-9895-4d1c-9547-1c025b79512a" released by "_delete_snapshot" :: held 1.468s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:53 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" released by "delete_snapshot" :: held 1.492s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:54 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Created reservations ['dcf3e576-0037-4904-9133-9efa1488e76f', '464563ce-11f0-4102-bb04-5a9cc84ac6e4', '00d740ea-2ac6-4634-b654-1ec470a8d82b', '66f8f62c-6a85-4b09-8928-52dbb5890746'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:54 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Delete snapshot completed successfully. Sep 16 16:30:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-f0effe08-8e3c-411c-a759-eee0133fea95 tempest-ProjectMemberTests-954186186 None] Lock "cinder-7077c374-9895-4d1c-9547-1c025b79512a-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Lock "cinder-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:30:54 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:30:54 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f0c110-cadd-4c79-9a27-e2197198e7e2]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:54 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:54 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 Sep 16 16:30:54 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:55 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" returned: 0 in 0.408s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:55 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2 Sep 16 16:30:55 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:55 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" returned: 0 in 0.269s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2" released by "delete_volume" :: held 0.752s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Created reservations ['64970e84-14f3-43b0-bab6-433da2b89d5b', '65be0d23-7ac9-467c-a79b-7044984b44c1', 'ae5c3d87-0367-463b-8db6-149728dd82bb', 'd2c92cb9-4ca6-4b5e-9899-aa79d30dfb9d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:55 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:30:55 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:55 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.283s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:30:55 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Deleted volume successfully. Sep 16 16:30:55 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-539f1daf-b0ce-4b0b-a27f-ccea2e0f25f8 tempest-ProjectMemberTests-954186186 None] Lock "cinder-ebfc1970-676e-4dbc-a18e-d4e7c24b4fd2-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (47464c25-2bf3-4724-aa0c-79c95dbaa575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099a8ff8-d99b-4e0c-91bd-c5fc6dd7479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099a8ff8-d99b-4e0c-91bd-c5fc6dd7479d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637401140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:56Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fab763-d949-477d-89b2-914df83081d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fab763-d949-477d-89b2-914df83081d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5df5c4-b1cc-4468-9c04-abf7eb3ddebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5df5c4-b1cc-4468-9c04-abf7eb3ddebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805', 'volume_name': 'volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51701796-38e9-4c81-a993-3718f05eb41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51701796-38e9-4c81-a993-3718f05eb41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082f6301-715e-4e80-a7df-e877d2fcd4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:56 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Volume d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805', 'volume_size': 1} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637401140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0cb9ee50e5454aaf65150b033e4102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:30:56Z,use_quota=True,user_id='9e78707c1da54a91b6bca6d893c589fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Creating volume d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:30:56 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:56 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 1073741824 Sep 16 16:30:56 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:56 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 1073741824" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:56 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:56 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 Sep 16 16:30:56 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:57 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" returned: 0 in 0.262s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:57 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:30:57 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:30:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082f6301-715e-4e80-a7df-e877d2fcd4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e19dd-bf77-49cd-80c3-8110f0545438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:30:57 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Volume volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 (d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805): created successfully Sep 16 16:30:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847e19dd-bf77-49cd-80c3-8110f0545438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:30:57 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Flow 'volume_create_manager' (47464c25-2bf3-4724-aa0c-79c95dbaa575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:30:57 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0a2ee4b1-dd13-4257-8ffa-b9294f96ad2f tempest-ProjectMemberTests-954186186 None] Created volume successfully. Sep 16 16:30:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:30:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:30:58 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Creating offline snapshot 050c63fb-f9d7-4281-aade-bf975f88a4db of volume d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:30:58 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcfd3d4-11cf-43db-8eb9-dfab2693144e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:30:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:58 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 Sep 16 16:30:58 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:58 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" returned: 0 in 0.431s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:58 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:59 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db 1G Sep 16 16:30:59 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:59 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db 1G" returned: 0 in 0.469s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:59 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db Sep 16 16:30:59 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:30:59 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 16 16:30:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db" returned: 0 in 0.342s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:30:59 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db is being set with open permissions: ugo+rw Sep 16 16:30:59 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:30:59 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db Sep 16 16:30:59 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:00 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db" returned: 0 in 0.278s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:00 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.info Sep 16 16:31:00 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:00 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.info" returned: 0 in 0.282s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:00 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.info is being set with open permissions: ugo+rw Sep 16 16:31:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:00 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.info Sep 16 16:31:00 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:00 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.info" returned: 0 in 0.259s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:00 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:00 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-41f7f4aa-35f2-4688-a13b-718cfa6d05bf tempest-ProjectMemberTests-954186186 None] Create snapshot completed successfully Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-050c63fb-f9d7-4281-aade-bf975f88a4db-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Lock "cinder-050c63fb-f9d7-4281-aade-bf975f88a4db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-050c63fb-f9d7-4281-aade-bf975f88a4db" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-050c63fb-f9d7-4281-aade-bf975f88a4db" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Deleting offline snapshot 050c63fb-f9d7-4281-aade-bf975f88a4db of volume d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] snapshot_file for this snap is: volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cfa04c-7090-44ed-b687-4b4fd94d1ccf]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:01 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:01 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db Sep 16 16:31:01 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:02 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db" returned: 0 in 0.368s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:02 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:31:02 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8604bc73-612d-41f0-8248-5c266aa67535]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:02 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 Sep 16 16:31:02 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:02 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" returned: 0 in 0.386s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:02 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:02 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db Sep 16 16:31:02 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:03 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db" returned: 0 in 0.382s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:03 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db Sep 16 16:31:03 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:03 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:03 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805.050c63fb-f9d7-4281-aade-bf975f88a4db" returned: 0 in 0.238s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-050c63fb-f9d7-4281-aade-bf975f88a4db" released by "_delete_snapshot" :: held 1.484s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" released by "delete_snapshot" :: held 1.514s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:03 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Created reservations ['c1168961-00c2-4ae4-ba35-db6b9de57bcf', 'ea82c9de-9d2f-45b4-9096-3fbc53b985d6', 'dce288ed-9b74-446e-8c44-0be14a9645b8', 'c4cdb771-3587-45c0-8ad2-45806718dbab'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:03 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Delete snapshot completed successfully. Sep 16 16:31:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-93500425-f648-428d-ab75-3e0a8af7f3c2 tempest-ProjectMemberTests-954186186 None] Lock "cinder-050c63fb-f9d7-4281-aade-bf975f88a4db-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:03 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Lock "cinder-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Acquiring lock "cinder-quobyte-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3957061-aea4-40b8-a5bb-e9a6744d252e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:04 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 Sep 16 16:31:04 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:04 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" returned: 0 in 0.394s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:04 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805 Sep 16 16:31:04 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:04 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" returned: 0 in 0.249s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Lock "cinder-quobyte-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805" released by "delete_volume" :: held 0.709s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Created reservations ['d9fe3b61-2db9-40e8-82a1-2cf3f58d2884', '6f2e19dd-e921-4fde-9b8c-d876cc08d835', '2f99e1d9-d7dc-455d-aa11-e720bb07fd7d', 'e76ed4d6-a1f9-4793-85b5-b18bed25eb17'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:04 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:04 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:31:04 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:05 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:05 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.249s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:05 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:31:05 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Deleted volume successfully. Sep 16 16:31:05 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-2819caa2-6f44-4958-83b8-a5bda7e5dd18 tempest-ProjectMemberTests-954186186 None] Lock "cinder-d2b7ad7b-7dc0-44de-b4f9-d0b2e25d2805-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (a534775a-8004-4330-8b7b-6583fb44697a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f343956-ae30-43e6-b2eb-23dec2713feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f343956-ae30-43e6-b2eb-23dec2713feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585493744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99062e0a-ef5c-4e4f-b360-2018a3ff03ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:09Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963c3c30-4931-4f26-8dd3-b762d236acc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963c3c30-4931-4f26-8dd3-b762d236acc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68214251-542e-4db8-8baa-9e71a87d5732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68214251-542e-4db8-8baa-9e71a87d5732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99062e0a-ef5c-4e4f-b360-2018a3ff03ea', 'volume_name': 'volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c77d64-1254-4e2f-a58d-1c7897507b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c77d64-1254-4e2f-a58d-1c7897507b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9df770-04b2-4964-b561-b8f628e203a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Volume 99062e0a-ef5c-4e4f-b360-2018a3ff03ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea', 'volume_size': 1} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585493744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99062e0a-ef5c-4e4f-b360-2018a3ff03ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:09Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Creating volume 99062e0a-ef5c-4e4f-b360-2018a3ff03ea {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:31:09 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:09 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea 1073741824 Sep 16 16:31:09 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:09 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea 1073741824" returned: 0 in 0.466s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:09 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea Sep 16 16:31:09 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:09 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" returned: 0 in 0.270s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f9df770-04b2-4964-b561-b8f628e203a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c1ae35-e016-4ee0-986b-1cdf057efb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:09 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Volume volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea (99062e0a-ef5c-4e4f-b360-2018a3ff03ea): created successfully Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c1ae35-e016-4ee0-986b-1cdf057efb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:09 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (a534775a-8004-4330-8b7b-6583fb44697a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:09 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-00377800-cbe9-4081-bd9b-3504cda2b773 tempest-ProjectReaderTests-1947879838 None] Created volume successfully. Sep 16 16:31:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:10 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Creating offline snapshot a2ee95df-d713-4600-a89d-0968e772fef1 of volume 99062e0a-ef5c-4e4f-b360-2018a3ff03ea {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:31:10 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05f427e-0d95-472a-9ce3-d58b54b3dec6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:10 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea Sep 16 16:31:10 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:10 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" returned: 0 in 0.384s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:10 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:10 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 1G Sep 16 16:31:10 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:11 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 1G" returned: 0 in 0.502s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:11 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 Sep 16 16:31:11 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:11 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1" returned: 0 in 0.360s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:11 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 is being set with open permissions: ugo+rw Sep 16 16:31:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:11 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 Sep 16 16:31:11 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:11 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1" returned: 0 in 0.260s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:11 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:11 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.info Sep 16 16:31:11 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:12 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.info" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:12 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.info is being set with open permissions: ugo+rw Sep 16 16:31:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:12 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.info Sep 16 16:31:12 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:12 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.info" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:12 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:12 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-0b7a8019-dae5-411b-9d8d-da8b8597a3f0 tempest-ProjectReaderTests-1947879838 None] Create snapshot completed successfully Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-a2ee95df-d713-4600-a89d-0968e772fef1-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-a2ee95df-d713-4600-a89d-0968e772fef1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-a2ee95df-d713-4600-a89d-0968e772fef1" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-a2ee95df-d713-4600-a89d-0968e772fef1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Deleting offline snapshot a2ee95df-d713-4600-a89d-0968e772fef1 of volume 99062e0a-ef5c-4e4f-b360-2018a3ff03ea {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] snapshot_file for this snap is: volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0516720-0b1f-448f-8495-1ce53b5cbe2f]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:13 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 Sep 16 16:31:13 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:14 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1" returned: 0 in 0.358s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:31:14 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df77684-4d38-4006-ada7-3ab860fc37c4]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:14 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea Sep 16 16:31:14 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:14 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" returned: 0 in 0.374s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:14 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 Sep 16 16:31:14 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:14 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1" returned: 0 in 0.348s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:14 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1 Sep 16 16:31:14 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:15 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea.a2ee95df-d713-4600-a89d-0968e772fef1" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-a2ee95df-d713-4600-a89d-0968e772fef1" released by "_delete_snapshot" :: held 1.447s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" released by "delete_snapshot" :: held 1.469s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Created reservations ['db9093ef-056e-401d-97bc-a214ec963b54', '83148202-caae-41d3-a04e-d23364f0bd20', '309b2ef5-6486-4bc3-a939-51a75294f12a', '870fa743-44ee-4bd5-9d4a-5578cba30c80'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:15 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Delete snapshot completed successfully. Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c19307b5-4af6-47eb-9c75-e8b8ed8798d9 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-a2ee95df-d713-4600-a89d-0968e772fef1-delete_snapshot" released by "delete_snapshot" :: held 1.615s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-99062e0a-ef5c-4e4f-b360-2018a3ff03ea-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-99062e0a-ef5c-4e4f-b360-2018a3ff03ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb35401-f3f9-4ec0-89ce-619c7ceb7135]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:16 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea Sep 16 16:31:16 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:16 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" returned: 0 in 0.376s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:16 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea Sep 16 16:31:16 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:16 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" returned: 0 in 0.253s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-99062e0a-ef5c-4e4f-b360-2018a3ff03ea" released by "delete_volume" :: held 0.698s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Created reservations ['934a5509-9ee3-41fc-b4d1-77e10beacc61', 'b5783b57-2b57-422e-8294-cbe5f9646135', '6f51a2d9-5611-4951-8d3a-f29011ba7d85', '5801d0e0-4ab1-4664-91b1-c4a59a85ec62'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:16 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:31:16 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:16 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.297s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:16 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:31:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Deleted volume successfully. Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-a314688e-fc8a-410d-9033-2f8d85296591 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-99062e0a-ef5c-4e4f-b360-2018a3ff03ea-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (46d40766-b28f-42de-8299-39d5e3dd579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becdd993-ba00-4012-8b29-c71e03d1b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (becdd993-ba00-4012-8b29-c71e03d1b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128925550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340a41f9-1bb1-4dc2-9ecc-2a90e2102517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:17Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d95344-e925-4f63-84a6-dbbfd73ba52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d95344-e925-4f63-84a6-dbbfd73ba52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967d8c1d-5eb6-40ff-a34b-5079c63e5364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967d8c1d-5eb6-40ff-a34b-5079c63e5364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340a41f9-1bb1-4dc2-9ecc-2a90e2102517', 'volume_name': 'volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7aa545-222d-419b-8728-aa781f32b291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7aa545-222d-419b-8728-aa781f32b291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356c3dc3-61e9-42b4-a3bc-9416ce53c627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:17 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Volume 340a41f9-1bb1-4dc2-9ecc-2a90e2102517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517', 'volume_size': 1} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128925550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340a41f9-1bb1-4dc2-9ecc-2a90e2102517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:17Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Creating volume 340a41f9-1bb1-4dc2-9ecc-2a90e2102517 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:31:17 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:17 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 1073741824 Sep 16 16:31:17 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:17 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 1073741824" returned: 0 in 0.442s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:18 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 Sep 16 16:31:18 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:18 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356c3dc3-61e9-42b4-a3bc-9416ce53c627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6df604-7e47-4070-8cb9-4378e9aceb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:18 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Volume volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 (340a41f9-1bb1-4dc2-9ecc-2a90e2102517): created successfully Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6df604-7e47-4070-8cb9-4378e9aceb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (46d40766-b28f-42de-8299-39d5e3dd579f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-404931ca-6c8f-4422-865d-e01f8d518ece tempest-ProjectReaderTests-1947879838 None] Created volume successfully. Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Creating offline snapshot 9a340b8f-5965-4b51-87f2-b440106d5369 of volume 340a41f9-1bb1-4dc2-9ecc-2a90e2102517 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[868b8453-5f99-4e3b-bf4a-188bb793c110]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:18 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 Sep 16 16:31:18 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:19 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" returned: 0 in 0.465s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:19 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 1G Sep 16 16:31:19 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:19 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 1G" returned: 0 in 0.470s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:19 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 Sep 16 16:31:19 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:19 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369" returned: 0 in 0.335s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:19 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 is being set with open permissions: ugo+rw Sep 16 16:31:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:19 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 Sep 16 16:31:19 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:20 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369" returned: 0 in 0.261s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:20 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.info Sep 16 16:31:20 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:20 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.info" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:20 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.info is being set with open permissions: ugo+rw Sep 16 16:31:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:20 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.info Sep 16 16:31:20 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:20 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.info" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:20 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-485c61e7-8f41-4d3d-8dc6-948f5a3f21ff tempest-ProjectReaderTests-1947879838 None] Create snapshot completed successfully Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-9a340b8f-5965-4b51-87f2-b440106d5369-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-9a340b8f-5965-4b51-87f2-b440106d5369-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-9a340b8f-5965-4b51-87f2-b440106d5369" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-9a340b8f-5965-4b51-87f2-b440106d5369" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Deleting offline snapshot 9a340b8f-5965-4b51-87f2-b440106d5369 of volume 340a41f9-1bb1-4dc2-9ecc-2a90e2102517 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] snapshot_file for this snap is: volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f884738-3bf5-43c4-a928-6b749cb1c024]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:21 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:22 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 Sep 16 16:31:22 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:22 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369" returned: 0 in 0.366s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:22 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:31:22 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf3b9e0-449b-4237-b76d-54490456224b]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:22 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 Sep 16 16:31:22 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:22 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" returned: 0 in 0.384s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:22 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:22 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 Sep 16 16:31:22 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:23 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369" returned: 0 in 0.397s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:23 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369 Sep 16 16:31:23 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:23 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:23 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517.9a340b8f-5965-4b51-87f2-b440106d5369" returned: 0 in 0.262s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-9a340b8f-5965-4b51-87f2-b440106d5369" released by "_delete_snapshot" :: held 1.521s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" released by "delete_snapshot" :: held 1.548s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:23 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Created reservations ['a695667a-b716-455d-adea-3abc58d00735', '3043edad-7aeb-415f-9b47-c6f4de090b38', '31d506f7-4635-4c44-aead-ca36692cac31', '3372a075-6011-4f51-9138-30c69166882d'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:23 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Delete snapshot completed successfully. Sep 16 16:31:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-b63e971f-f621-49bf-93bd-922d41c242e4 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-9a340b8f-5965-4b51-87f2-b440106d5369-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:23 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-340a41f9-1bb1-4dc2-9ecc-2a90e2102517-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-340a41f9-1bb1-4dc2-9ecc-2a90e2102517-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d39f28-f0ee-4416-95a1-12116df4c9f6]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:24 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 Sep 16 16:31:24 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:24 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" returned: 0 in 0.392s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:24 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517 Sep 16 16:31:24 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:24 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" returned: 0 in 0.280s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-340a41f9-1bb1-4dc2-9ecc-2a90e2102517" released by "delete_volume" :: held 0.766s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Created reservations ['a8eccaa6-2106-430c-ac70-df6f6e9cf52a', '3b609885-09b2-4ca1-ba65-27a13804f44a', '340cf3a4-4e7b-4c58-b775-8ad3da3526d9', 'c3a3a6d1-2083-4e09-a9c9-3fc115c32d3a'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:24 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:25 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:31:25 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:25 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:31:25 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Deleted volume successfully. Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-9c31224c-bd62-42a0-b27d-1971a7ab0d40 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-340a41f9-1bb1-4dc2-9ecc-2a90e2102517-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (05e097af-4612-4087-bd75-c166455b6588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086edd1d-c81b-4741-9bb5-703e7c39530d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (086edd1d-c81b-4741-9bb5-703e7c39530d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906039418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:26Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240b3f99-2c49-4218-9508-91c21e00ba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240b3f99-2c49-4218-9508-91c21e00ba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea562d0e-3a17-4e0c-adcb-b6cd5e23a881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea562d0e-3a17-4e0c-adcb-b6cd5e23a881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb', 'volume_name': 'volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2545fcd0-0f80-404a-b5ba-db7b5bc21a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2545fcd0-0f80-404a-b5ba-db7b5bc21a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eff1f61-a4d5-4db7-825a-a767f9e7b264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:25 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Volume 6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb', 'volume_size': 1} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906039418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:26Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Creating volume 6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:31:25 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:31:25 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:25 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb 1073741824 Sep 16 16:31:25 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:26 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb 1073741824" returned: 0 in 0.456s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:26 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb Sep 16 16:31:26 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:26 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" returned: 0 in 0.262s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eff1f61-a4d5-4db7-825a-a767f9e7b264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b5bf5e-e070-45d3-9ee2-5815d0a8078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:26 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Volume volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb (6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb): created successfully Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b5bf5e-e070-45d3-9ee2-5815d0a8078f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (05e097af-4612-4087-bd75-c166455b6588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:26 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5225230d-b975-4b8d-8c36-c726e337467e tempest-ProjectReaderTests-1947879838 None] Created volume successfully. Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Creating offline snapshot febebd92-274e-4ac3-bf75-21191ff9d5bd of volume 6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c4abf3-1d9d-41bb-b298-d76445640a49]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:26 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:27 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb Sep 16 16:31:27 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:27 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" returned: 0 in 0.391s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:27 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd 1G Sep 16 16:31:27 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:27 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd 1G" returned: 0 in 0.415s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:27 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:27 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd Sep 16 16:31:27 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:28 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd" returned: 0 in 0.298s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:28 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd is being set with open permissions: ugo+rw Sep 16 16:31:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:28 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd Sep 16 16:31:28 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:28 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd" returned: 0 in 0.247s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:28 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.info Sep 16 16:31:28 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:28 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.info" returned: 0 in 0.249s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:28 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.info is being set with open permissions: ugo+rw Sep 16 16:31:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:28 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.info Sep 16 16:31:28 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:28 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.info" returned: 0 in 0.262s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:28 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.965s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:28 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e5387c7b-ec74-4fe1-9a36-66db78921e23 tempest-ProjectReaderTests-1947879838 None] Create snapshot completed successfully Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-febebd92-274e-4ac3-bf75-21191ff9d5bd-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Lock "cinder-febebd92-274e-4ac3-bf75-21191ff9d5bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-febebd92-274e-4ac3-bf75-21191ff9d5bd" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-febebd92-274e-4ac3-bf75-21191ff9d5bd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Deleting offline snapshot febebd92-274e-4ac3-bf75-21191ff9d5bd of volume 6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] snapshot_file for this snap is: volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce2248-8b95-49e9-9318-38b2713d6591]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:29 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd Sep 16 16:31:29 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:29 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd" returned: 0 in 0.374s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bb8c9b-9c3d-4336-ae9b-6ef8682f4881]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:29 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb Sep 16 16:31:29 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:29 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" returned: 0 in 0.386s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:29 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:29 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd Sep 16 16:31:29 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:30 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd" returned: 0 in 0.350s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:30 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd Sep 16 16:31:30 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:30 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:30 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb.febebd92-274e-4ac3-bf75-21191ff9d5bd" returned: 0 in 0.252s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-febebd92-274e-4ac3-bf75-21191ff9d5bd" released by "_delete_snapshot" :: held 1.464s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" released by "delete_snapshot" :: held 1.487s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:30 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=97,cinder:INSERT=39,cinder:UPDATE=127,cinder:DELETE=9 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:31:30 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=125,cinder:SELECT=97,cinder:INSERT=31,cinder:DELETE=12 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:31:30 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Created reservations ['32ded6a7-5701-47b7-9492-e57c65fc5c57', '833870bb-c112-4bf1-ac75-6441e1e95e58', '5e75b5df-9fc6-4181-b814-8c48c0ba77bb', '78383aca-3c8a-4217-8cf2-e50ae5eaaab0'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:30 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Delete snapshot completed successfully. Sep 16 16:31:30 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-c1d18bfc-ef51-464b-b3b5-d0ea499206ea tempest-ProjectReaderTests-1947879838 None] Lock "cinder-febebd92-274e-4ac3-bf75-21191ff9d5bd-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:31 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:31 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48fd3ac-8519-4e2f-ad86-4050af1c8e2a]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:31 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb Sep 16 16:31:31 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:31 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" returned: 0 in 0.389s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:31 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:31 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb Sep 16 16:31:31 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:32 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb" released by "delete_volume" :: held 0.723s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Created reservations ['2fcebbac-e2b1-4864-9666-d375dc101249', 'f98a7ace-74b1-4a66-a82f-f5deea5c17d8', 'dab842e0-c621-43ef-a38e-5f0db1d18540', 'd37006e3-ea7d-491f-8370-4ed2de58abfd'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:32 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:31:32 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:32 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:31:32 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Deleted volume successfully. Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-eabb01a1-52c2-4f64-a2fc-abbc74d9c045 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-6a4f6fa1-e320-4046-aa4f-92c8ec71b6fb-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (049d20e4-4afe-4f8c-832a-51aaba4c9d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:32 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da267e2-a0b1-4b06-8d58-eff77c173c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9da267e2-a0b1-4b06-8d58-eff77c173c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923209488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34b0d1e-8e43-4340-8d0a-5a212c741674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:33Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4c52d5-45d9-41b2-8ff1-ae87ac4acac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4c52d5-45d9-41b2-8ff1-ae87ac4acac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb96f39e-f442-4bc2-9ed9-a886bd50a754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb96f39e-f442-4bc2-9ed9-a886bd50a754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34b0d1e-8e43-4340-8d0a-5a212c741674', 'volume_name': 'volume-d34b0d1e-8e43-4340-8d0a-5a212c741674', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6aad4e-818f-4c42-8a99-1da94fcbd5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6aad4e-818f-4c42-8a99-1da94fcbd5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e427ee89-177b-4376-be01-55f2e35fc5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Volume d34b0d1e-8e43-4340-8d0a-5a212c741674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34b0d1e-8e43-4340-8d0a-5a212c741674', 'volume_size': 1} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923209488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34b0d1e-8e43-4340-8d0a-5a212c741674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:33Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Creating volume d34b0d1e-8e43-4340-8d0a-5a212c741674 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:31:33 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:33 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 1073741824 Sep 16 16:31:33 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:33 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 1073741824" returned: 0 in 0.435s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:33 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 Sep 16 16:31:33 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:33 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674" returned: 0 in 0.269s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e427ee89-177b-4376-be01-55f2e35fc5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34b0d1e-8e43-4340-8d0a-5a212c741674', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d5de2e-7159-47c3-be0f-e59aab39cf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:33 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Volume volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 (d34b0d1e-8e43-4340-8d0a-5a212c741674): created successfully Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d5de2e-7159-47c3-be0f-e59aab39cf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:33 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (049d20e4-4afe-4f8c-832a-51aaba4c9d6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:33 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1f289ebd-0274-41f9-a28c-3e4af0d0adf8 tempest-ProjectReaderTests-1947879838 None] Created volume successfully. Sep 16 16:31:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:34 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Creating offline snapshot 43650e51-3f1e-43e8-8c23-68c60e4d8e2e of volume d34b0d1e-8e43-4340-8d0a-5a212c741674 {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:31:34 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac2f275-6dd0-4f0c-8aca-1b2060655b68]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:34 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 Sep 16 16:31:34 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:34 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674" returned: 0 in 0.405s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:34 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:34 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e 1G Sep 16 16:31:34 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:35 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e 1G" returned: 0 in 0.462s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:35 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e Sep 16 16:31:35 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:35 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e" returned: 0 in 0.302s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:35 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e is being set with open permissions: ugo+rw Sep 16 16:31:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:35 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e Sep 16 16:31:35 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:35 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e" returned: 0 in 0.264s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:35 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.info Sep 16 16:31:35 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:35 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.info" returned: 0 in 0.295s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:35 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.info is being set with open permissions: ugo+rw Sep 16 16:31:35 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:35 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.info Sep 16 16:31:35 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:36 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.info" returned: 0 in 0.286s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:36 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:36 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5f75470e-91bd-4298-be69-60f1a556c2c6 tempest-ProjectReaderTests-1947879838 None] Create snapshot completed successfully Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-43650e51-3f1e-43e8-8c23-68c60e4d8e2e-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-43650e51-3f1e-43e8-8c23-68c60e4d8e2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-d34b0d1e-8e43-4340-8d0a-5a212c741674" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-d34b0d1e-8e43-4340-8d0a-5a212c741674" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-43650e51-3f1e-43e8-8c23-68c60e4d8e2e" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-43650e51-3f1e-43e8-8c23-68c60e4d8e2e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Deleting offline snapshot 43650e51-3f1e-43e8-8c23-68c60e4d8e2e of volume d34b0d1e-8e43-4340-8d0a-5a212c741674 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] snapshot_file for this snap is: volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d502857-a333-4160-9f9f-723df1a061dd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:37 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e Sep 16 16:31:37 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:37 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e" returned: 0 in 0.410s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34b0d1e-8e43-4340-8d0a-5a212c741674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[56589cd3-86c2-473f-b603-3143370fd7c5]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:37 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:37 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 Sep 16 16:31:37 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:38 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674" returned: 0 in 0.393s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:38 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e Sep 16 16:31:38 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:38 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e" returned: 0 in 0.363s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:38 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e Sep 16 16:31:38 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:38 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:38 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674.43650e51-3f1e-43e8-8c23-68c60e4d8e2e" returned: 0 in 0.264s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-43650e51-3f1e-43e8-8c23-68c60e4d8e2e" released by "_delete_snapshot" :: held 1.545s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:38 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-d34b0d1e-8e43-4340-8d0a-5a212c741674" released by "delete_snapshot" :: held 1.568s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:38 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Created reservations ['52adbc66-b540-4bc5-9ed7-938f7fb0b0a6', '95fbd4b2-cd49-4119-afda-bcbbeaef813f', '58fe8b2d-01f5-4817-93e0-5c578d1100cf', 'e169605f-8858-45ff-8414-26ee5753f468'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:39 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Delete snapshot completed successfully. Sep 16 16:31:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-13b7ee67-6e45-4634-a3c8-6bbde2f7cb81 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-43650e51-3f1e-43e8-8c23-68c60e4d8e2e-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-d34b0d1e-8e43-4340-8d0a-5a212c741674-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-d34b0d1e-8e43-4340-8d0a-5a212c741674-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-d34b0d1e-8e43-4340-8d0a-5a212c741674" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:39 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-d34b0d1e-8e43-4340-8d0a-5a212c741674" acquired by "delete_volume" :: waited 0.017s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:39 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e464a-bbf7-4238-af79-af77b5c9da43]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:39 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:39 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 Sep 16 16:31:39 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:40 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674" returned: 0 in 0.398s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:40 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674 Sep 16 16:31:40 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:40 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d34b0d1e-8e43-4340-8d0a-5a212c741674" returned: 0 in 0.257s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-d34b0d1e-8e43-4340-8d0a-5a212c741674" released by "delete_volume" :: held 0.720s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Created reservations ['68504e9c-b5f1-4d09-bc73-7948d6ba5778', '75b018d6-b7e7-4797-95a9-392d9f49c6da', '0149bc7d-f2fb-4aab-9193-20e64e149e65', '2247ed8a-5ab9-4d53-aa75-513179f01588'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:40 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:31:40 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:40 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:31:40 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Deleted volume successfully. Sep 16 16:31:40 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-e66291a6-6e88-4aa5-88de-b8edcd598d08 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-d34b0d1e-8e43-4340-8d0a-5a212c741674-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (39bcf2f7-958c-407f-9ccf-135935ab9be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b7ad0b-8dea-47b3-b3d0-b1e9d19f3671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b7ad0b-8dea-47b3-b3d0-b1e9d19f3671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256122960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:41Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4616602a-ca78-40d1-a9f8-3f2ab5d06960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4616602a-ca78-40d1-a9f8-3f2ab5d06960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8593f26a-a549-4fc7-ad83-469ae2c28fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8593f26a-a549-4fc7-ad83-469ae2c28fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc', 'volume_name': 'volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bd8b54-3d3e-40a0-8a35-409ebd94c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bd8b54-3d3e-40a0-8a35-409ebd94c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70af256d-b495-4802-8e26-65a18157ffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:41 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Volume d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc', 'volume_size': 1} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:31:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256122960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37b88982d721431099bda8b70f0fdcbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:31:41Z,use_quota=True,user_id='9043e3575c794730ab59ff6b642fa6ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Creating volume d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:31:41 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:41 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc 1073741824 Sep 16 16:31:41 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:41 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:31:41 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:41 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc 1073741824" returned: 0 in 0.479s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:41 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc Sep 16 16:31:41 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:42 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.290s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 29 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 16 16:31:42 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" returned: 0 in 0.270s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70af256d-b495-4802-8e26-65a18157ffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e75e043-278c-47f5-9fa8-8a6061825b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:31:42 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Volume volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc (d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc): created successfully Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e75e043-278c-47f5-9fa8-8a6061825b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:31:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Flow 'volume_create_manager' (39bcf2f7-958c-407f-9ccf-135935ab9be4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:31:42 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-c5e06730-32a9-46d6-88b9-3bba9a8b817d tempest-ProjectReaderTests-1947879838 None] Created volume successfully. Sep 16 16:31:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:43 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Creating offline snapshot fb4c9a3c-d092-493f-8a7d-eb315ab434e3 of volume d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc {{(pid=86255) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 16 16:31:43 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0153ed0-04e8-48f8-b040-c3b7fcb5694e]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:43 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc Sep 16 16:31:43 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:43 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" returned: 0 in 0.431s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:43 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 1G {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:44 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 1G Sep 16 16:31:44 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:44 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 1G" returned: 0 in 0.445s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:44 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 Sep 16 16:31:44 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:44 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc -F qcow2 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3" returned: 0 in 0.328s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:44 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 is being set with open permissions: ugo+rw Sep 16 16:31:44 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:44 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 Sep 16 16:31:44 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:45 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3" returned: 0 in 0.273s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:45 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.info Sep 16 16:31:45 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:45 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.info" returned: 0 in 0.275s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:45 devstack cinder-volume[86255]: WARNING cinder.volume.drivers.remotefs [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.info is being set with open permissions: ugo+rw Sep 16 16:31:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.info {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:45 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.info Sep 16 16:31:45 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:45 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.info" returned: 0 in 0.267s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:45 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:45 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-5baa1163-1460-4233-ac3e-d3404c270472 tempest-ProjectReaderTests-1947879838 None] Create snapshot completed successfully Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-fb4c9a3c-d092-493f-8a7d-eb315ab434e3-delete_snapshot" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-fb4c9a3c-d092-493f-8a7d-eb315ab434e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" by "delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-fb4c9a3c-d092-493f-8a7d-eb315ab434e3" by "_delete_snapshot" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-fb4c9a3c-d092-493f-8a7d-eb315ab434e3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Deleting offline snapshot fb4c9a3c-d092-493f-8a7d-eb315ab434e3 of volume d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] snapshot_file for this snap is: volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 {{(pid=86255) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c06083-2efd-483d-8a93-4d369b5d4521]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:46 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:46 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 Sep 16 16:31:46 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:47 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3" returned: 0 in 0.398s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:47 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86255) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 16 16:31:47 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a7c1de-68c6-4d39-9bbb-44f18f46c824]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:47 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc Sep 16 16:31:47 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:47 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" returned: 0 in 0.397s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:47 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:47 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 Sep 16 16:31:47 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:48 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3" returned: 0 in 0.371s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:48 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3 Sep 16 16:31:48 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:48 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc.fb4c9a3c-d092-493f-8a7d-eb315ab434e3" returned: 0 in 0.271s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-fb4c9a3c-d092-493f-8a7d-eb315ab434e3" released by "_delete_snapshot" :: held 1.558s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" released by "delete_snapshot" :: held 1.587s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Created reservations ['d943868f-3806-4d52-83dd-ba003e611bbd', '25fb208e-102b-40e2-864d-93963a4c7324', '57f11239-15e3-4293-85e2-ccf1a17c1564', '1b244f5a-574b-4d9f-b520-2f073c43ff07'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:48 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Delete snapshot completed successfully. Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-42ce6ca7-c928-429c-a73d-8b7cf32039d5 tempest-ProjectReaderTests-1947879838 None] Lock "cinder-fb4c9a3c-d092-493f-8a7d-eb315ab434e3-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Lock "cinder-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Acquiring lock "cinder-quobyte-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:31:48 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" acquired by "delete_volume" :: waited 0.022s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c15845-f90d-42a1-abff-283ff1d8c129]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:49 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc Sep 16 16:31:49 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:49 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" returned: 0 in 0.402s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:49 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc Sep 16 16:31:49 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:49 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" returned: 0 in 0.270s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Lock "cinder-quobyte-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc" released by "delete_volume" :: held 0.744s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Created reservations ['b109d362-8384-483f-81ba-862f6cf4c569', 'e07ee263-011b-43d7-ae44-3a8899af994c', '3a91b811-d42d-45af-81cd-c97dd71ec39b', '5f9e7b9d-a697-4f85-91d4-65e922611dd1'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:31:49 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:31:49 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:31:49 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:31:50 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 16 16:31:50 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.315s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:31:50 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:31:50 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Deleted volume successfully. Sep 16 16:31:50 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-208f802f-d566-4734-9117-45ef0c6dcaaf tempest-ProjectReaderTests-1947879838 None] Lock "cinder-d0e0b244-4fe8-4b96-8136-3cd7c3cb5fdc-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:31:59 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:INSERT=16,cinder:UPDATE=51,cinder:SELECT=38,cinder:DELETE=2 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:32:00 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=36,cinder:INSERT=12,cinder:UPDATE=49,cinder:DELETE=5 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Flow 'volume_create_manager' (0f73ff68-6ee1-4ec9-9c07-8db7bba31c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfbf19a-4d84-4ca8-9c2d-a06cf950733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfbf19a-4d84-4ca8-9c2d-a06cf950733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883553865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec29930-028d-41b6-ac7b-801dd76a2190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec3323c66df423cb0162e836b047603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:13Z,use_quota=True,user_id='11a1af14bd924362b4659e052262b6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88416178-a569-4836-8bc3-e4cfd6bb995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88416178-a569-4836-8bc3-e4cfd6bb995f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bf3e4f-831e-4417-91b9-e04ff3fb1f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bf3e4f-831e-4417-91b9-e04ff3fb1f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec29930-028d-41b6-ac7b-801dd76a2190', 'volume_name': 'volume-5ec29930-028d-41b6-ac7b-801dd76a2190', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddd6b62-efe3-4fbd-977a-51f76b2b8a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddd6b62-efe3-4fbd-977a-51f76b2b8a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3903201e-3c8e-45c5-a391-a1a95c410484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:13 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Volume 5ec29930-028d-41b6-ac7b-801dd76a2190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec29930-028d-41b6-ac7b-801dd76a2190', 'volume_size': 1} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-883553865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec29930-028d-41b6-ac7b-801dd76a2190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec3323c66df423cb0162e836b047603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:13Z,use_quota=True,user_id='11a1af14bd924362b4659e052262b6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Creating volume 5ec29930-028d-41b6-ac7b-801dd76a2190 {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:32:13 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:13 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190 1073741824 Sep 16 16:32:13 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:13 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190 1073741824" returned: 0 in 0.457s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:13 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:13 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190 Sep 16 16:32:13 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:14 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190" returned: 0 in 0.278s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:14 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:32:14 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:32:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3903201e-3c8e-45c5-a391-a1a95c410484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec29930-028d-41b6-ac7b-801dd76a2190', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bc58f3-4fb7-48de-847a-a2200adb7b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:14 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Volume volume-5ec29930-028d-41b6-ac7b-801dd76a2190 (5ec29930-028d-41b6-ac7b-801dd76a2190): created successfully Sep 16 16:32:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bc58f3-4fb7-48de-847a-a2200adb7b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:14 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Flow 'volume_create_manager' (0f73ff68-6ee1-4ec9-9c07-8db7bba31c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:32:14 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-f037473f-a9d9-41e2-a288-d5629c4fd88e tempest-ProjectReaderTests-2117626424 None] Created volume successfully. Sep 16 16:32:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Acquiring lock "cinder-5ec29930-028d-41b6-ac7b-801dd76a2190-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:32:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Lock "cinder-5ec29930-028d-41b6-ac7b-801dd76a2190-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:32:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Acquiring lock "cinder-quobyte-5ec29930-028d-41b6-ac7b-801dd76a2190" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:32:15 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Lock "cinder-quobyte-5ec29930-028d-41b6-ac7b-801dd76a2190" acquired by "delete_volume" :: waited 0.018s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:32:15 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[869e878c-470b-4cb7-9c2b-7473ede723ef]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:32:15 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:15 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190 Sep 16 16:32:15 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:16 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190" returned: 0 in 0.427s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:16 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190 Sep 16 16:32:16 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:16 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-5ec29930-028d-41b6-ac7b-801dd76a2190" returned: 0 in 0.318s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Lock "cinder-quobyte-5ec29930-028d-41b6-ac7b-801dd76a2190" released by "delete_volume" :: held 0.797s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Created reservations ['f5841327-634f-4da3-ab28-dc050888e4df', 'c355dd7e-3a75-4e96-a419-c08c14e9c54d', 'e4688290-1502-4247-8aaf-a9ff371bfa1f', '95983723-6f73-4fa5-b7f0-9df37c700fbb'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:16 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:32:16 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:16 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.287s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:32:16 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Deleted volume successfully. Sep 16 16:32:16 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1893d5a6-da18-4c0b-8bc0-fbe02296c645 tempest-ProjectReaderTests-2117626424 None] Lock "cinder-5ec29930-028d-41b6-ac7b-801dd76a2190-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.flows.manager.create_volume [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86255) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Flow 'volume_create_manager' (7c8e57c4-da37-42de-96fa-b1c0dfcc15a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be6256-0422-44c8-b080-e0ac6fa32a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be6256-0422-44c8-b080-e0ac6fa32a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-68276703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d44d2f-26e9-4213-9797-8d810b235a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec3323c66df423cb0162e836b047603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:17Z,use_quota=True,user_id='11a1af14bd924362b4659e052262b6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691f8f70-4aa5-46e1-a38c-683ab4f660e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (691f8f70-4aa5-46e1-a38c-683ab4f660e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec88411-e121-4d72-a1ac-47676164ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec88411-e121-4d72-a1ac-47676164ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d44d2f-26e9-4213-9797-8d810b235a0c', 'volume_name': 'volume-50d44d2f-26e9-4213-9797-8d810b235a0c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c85a58-bc0f-40a3-a062-1d80a7fc5ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97c85a58-bc0f-40a3-a062-1d80a7fc5ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b59faf7-2564-4ebc-b846-d64bf784378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:17 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Volume 50d44d2f-26e9-4213-9797-8d810b235a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d44d2f-26e9-4213-9797-8d810b235a0c', 'volume_size': 1} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-16T14:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-68276703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d44d2f-26e9-4213-9797-8d810b235a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec3323c66df423cb0162e836b047603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-16T14:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-16T14:32:17Z,use_quota=True,user_id='11a1af14bd924362b4659e052262b6a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8db82d65-09d4-489e-ad24-8e7494b81136),volume_type_id=8db82d65-09d4-489e-ad24-8e7494b81136)}" {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.remotefs [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Creating volume 50d44d2f-26e9-4213-9797-8d810b235a0c {{(pid=86255) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Selected osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef as target Quobyte volume. {{(pid=86255) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 16 16:32:17 devstack cinder-volume[86255]: INFO cinder.volume.drivers.remotefs [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] casted to osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c 1073741824 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:17 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c 1073741824 Sep 16 16:32:17 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:17 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c 1073741824" returned: 0 in 0.504s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:17 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:17 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c Sep 16 16:32:17 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:18 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c" returned: 0 in 0.276s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:18 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'} {{(pid=86255) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 16 16:32:18 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:32:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b59faf7-2564-4ebc-b846-d64bf784378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d44d2f-26e9-4213-9797-8d810b235a0c', 'volume_size': 1}' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ee0619-5de6-4916-882b-00eb1e504db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 16 16:32:18 devstack cinder-volume[86255]: INFO cinder.volume.flows.manager.create_volume [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Volume volume-50d44d2f-26e9-4213-9797-8d810b235a0c (50d44d2f-26e9-4213-9797-8d810b235a0c): created successfully Sep 16 16:32:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ee0619-5de6-4916-882b-00eb1e504db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86255) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 16 16:32:18 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Flow 'volume_create_manager' (7c8e57c4-da37-42de-96fa-b1c0dfcc15a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86255) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 16 16:32:18 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-663e2bdd-e888-493d-8550-03af8a853db7 tempest-ProjectReaderTests-2117626424 None] Created volume successfully. Sep 16 16:32:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Acquiring lock "cinder-50d44d2f-26e9-4213-9797-8d810b235a0c-delete_volume" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:32:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Lock "cinder-50d44d2f-26e9-4213-9797-8d810b235a0c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:32:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Acquiring lock "cinder-quobyte-50d44d2f-26e9-4213-9797-8d810b235a0c" by "delete_volume" {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 16 16:32:19 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Lock "cinder-quobyte-50d44d2f-26e9-4213-9797-8d810b235a0c" acquired by "delete_volume" :: waited 0.016s {{(pid=86255) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 16 16:32:19 devstack cinder-volume[86255]: DEBUG oslo.privsep.daemon [-] privsep: reply[df928069-10f7-4c1f-839d-b6413948cfdd]: (4, 'qcow2') {{(pid=87707) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 16 16:32:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:19 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c Sep 16 16:32:19 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:19 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c" returned: 0 in 0.441s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:19 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:20 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c Sep 16 16:32:20 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:20 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87/volume-50d44d2f-26e9-4213-9797-8d810b235a0c" returned: 0 in 0.336s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Lock "cinder-quobyte-50d44d2f-26e9-4213-9797-8d810b235a0c" released by "delete_volume" :: held 0.833s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG cinder.quota [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Created reservations ['754148cb-89e0-403a-a460-7b9d416ff8f9', '4c3ba4f2-91b6-4239-a74c-35f56c5ee762', '10279064-b6f0-4f7b-8421-24f38370c81f', 'fd3a6651-94c1-4898-920b-f595ba55943e'] {{(pid=86255) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:20 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:32:20 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:20 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.341s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:32:20 devstack cinder-volume[86255]: INFO cinder.volume.manager [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Deleted volume successfully. Sep 16 16:32:20 devstack cinder-volume[86255]: DEBUG cinder.coordination [None req-1b685315-39a2-46cd-9dd5-87938539c917 tempest-ProjectReaderTests-2117626424 None] Lock "cinder-50d44d2f-26e9-4213-9797-8d810b235a0c-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86255) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 16 16:32:30 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:UPDATE=23,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:32:30 devstack cinder-volume[86255]: DEBUG dbcounter [-] [86255] Writing DB stats cinder:SELECT=15,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86255) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 16 16:32:41 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:32:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 16 16:32:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 16 16:32:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef': None} {{(pid=86255) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 16 16:32:41 devstack cinder-volume[86255]: DEBUG cinder.volume.drivers.quobyte [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3b33a81-53cf-49f4-84ca-14cc8ffb74ef'] {{(pid=86255) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 16 16:32:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.lockutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86255) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 16 16:32:41 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 16 16:32:41 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87 Sep 16 16:32:41 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 16:32:42 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 16 16:32:42 devstack cinder-volume[86255]: DEBUG oslo_concurrency.processutils [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aaaed3b4236e898deaf3770f80797a87" returned: 0 in 0.259s {{(pid=86255) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 16 16:32:42 devstack cinder-volume[86255]: DEBUG cinder.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Notifying Schedulers of capabilities ... {{(pid=86255) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 16 16:32:42 devstack cinder-volume[86255]: DEBUG oslo_service.periodic_task [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] Running periodic task VolumeManager._thread_info {{(pid=86255) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 16 16:32:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread count: 29 {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 16 16:32:42 devstack cinder-volume[86255]: DEBUG cinder.volume.manager [None req-3dd28798-2259-478d-8ef8-b8fba9ee9d4a None None] thread info: [<_MainThread(MainThread, started 136487591915648)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86255) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}